-- Logs begin at Thu 2022-06-30 09:18:49 UTC, end at Thu 2022-06-30 10:18:57 UTC. -- Jun 30 09:51:54.275307 dv-cinder-843309-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 30 09:51:54.284187 dv-cinder-843309-3-iscsi devstack@n-api.service[103117]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 30 09:51:54.286129 dv-cinder-843309-3-iscsi devstack@n-api.service[103117]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 30 09:51:54 2022] *** Jun 30 09:51:54.286129 dv-cinder-843309-3-iscsi devstack@n-api.service[103117]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 30 09:51:54.286129 dv-cinder-843309-3-iscsi devstack@n-api.service[103117]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 30 09:51:54.286129 dv-cinder-843309-3-iscsi devstack@n-api.service[103117]: nodename: dv-cinder-843309-3-iscsi Jun 30 09:51:54.286129 dv-cinder-843309-3-iscsi devstack@n-api.service[103117]: machine: x86_64 Jun 30 09:51:54.286129 dv-cinder-843309-3-iscsi devstack@n-api.service[103117]: clock source: unix Jun 30 09:51:54.286129 dv-cinder-843309-3-iscsi devstack@n-api.service[103117]: pcre jit disabled Jun 30 09:51:54.286129 dv-cinder-843309-3-iscsi devstack@n-api.service[103117]: detected number of CPU cores: 4 Jun 30 09:51:54.286129 dv-cinder-843309-3-iscsi devstack@n-api.service[103117]: current working directory: / Jun 30 09:51:54.286129 dv-cinder-843309-3-iscsi devstack@n-api.service[103117]: detected binary path: /usr/bin/uwsgi-core Jun 30 09:51:54.286959 dv-cinder-843309-3-iscsi devstack@n-api.service[103117]: your processes number limit is 47680 Jun 30 09:51:54.286959 dv-cinder-843309-3-iscsi devstack@n-api.service[103117]: your memory page size is 4096 bytes Jun 30 09:51:54.286959 dv-cinder-843309-3-iscsi devstack@n-api.service[103117]: detected max file descriptor number: 2048 Jun 30 09:51:54.286959 dv-cinder-843309-3-iscsi devstack@n-api.service[103117]: lock engine: pthread robust mutexes Jun 30 09:51:54.286959 dv-cinder-843309-3-iscsi devstack@n-api.service[103117]: thunder lock: enabled Jun 30 09:51:54.286959 dv-cinder-843309-3-iscsi devstack@n-api.service[103117]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 30 09:51:54.287360 dv-cinder-843309-3-iscsi devstack@n-api.service[103117]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 30 09:51:54.329329 dv-cinder-843309-3-iscsi devstack@n-api.service[103117]: Python main interpreter initialized at 0x561aa59a29c0 Jun 30 09:51:54.329329 dv-cinder-843309-3-iscsi devstack@n-api.service[103117]: python threads support enabled Jun 30 09:51:54.329329 dv-cinder-843309-3-iscsi devstack@n-api.service[103117]: your server socket listen backlog is limited to 100 connections Jun 30 09:51:54.329329 dv-cinder-843309-3-iscsi devstack@n-api.service[103117]: your mercy for graceful operations on workers is 90 seconds Jun 30 09:51:54.329694 dv-cinder-843309-3-iscsi devstack@n-api.service[103117]: mapped 403077 bytes (393 KB) for 2 cores Jun 30 09:51:54.329694 dv-cinder-843309-3-iscsi devstack@n-api.service[103117]: *** Operational MODE: preforking *** Jun 30 09:51:54.329992 dv-cinder-843309-3-iscsi devstack@n-api.service[103117]: *** uWSGI is running in multiple interpreter mode *** Jun 30 09:51:54.329992 dv-cinder-843309-3-iscsi devstack@n-api.service[103117]: spawned uWSGI master process (pid: 103117) Jun 30 09:51:54.330194 dv-cinder-843309-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 30 09:51:54.332221 dv-cinder-843309-3-iscsi devstack@n-api.service[103117]: spawned uWSGI worker 1 (pid: 103118, cores: 1) Jun 30 09:51:54.332221 dv-cinder-843309-3-iscsi devstack@n-api.service[103117]: spawned uWSGI worker 2 (pid: 103119, cores: 1) Jun 30 09:51:54.332221 dv-cinder-843309-3-iscsi devstack@n-api.service[103117]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 30 09:51:54.970379 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 30 09:51:54.972801 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 30 09:51:56.072589 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 09:51:56.072589 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: from cryptography.utils import int_from_bytes Jun 30 09:51:56.073305 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 09:51:56.073305 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: from cryptography.utils import int_from_bytes Jun 30 09:51:56.073676 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 09:51:56.073676 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: from cryptography.utils import int_from_bytes Jun 30 09:51:56.073829 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 09:51:56.073829 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: from cryptography.utils import int_from_bytes Jun 30 09:51:58.503818 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 09:51:58.504539 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 09:51:58.504867 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 09:51:58.504957 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 09:51:58.505034 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 09:51:58.505106 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 09:51:58.505172 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 09:51:58.505244 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 09:51:58.505317 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 09:51:58.505383 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 09:51:58.505569 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.505697 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.505789 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.506046 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.506191 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.506323 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.506411 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.506656 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.506789 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.506961 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.507033 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.507266 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.507399 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.507551 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.507657 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.507912 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.508040 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.508147 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.508225 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.508454 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.508605 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.508775 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843309-3-iscsi {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.508906 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.509085 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.509218 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843309-3-iscsi {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.509362 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.509507 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.509634 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.509754 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.509958 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.510148 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.510297 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.510435 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.510559 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.510678 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.510807 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.510944 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.511075 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.511280 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.511739 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.511897 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.512026 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.512141 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.512253 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.512356 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.512472 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.512672 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.512798 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.512932 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.513059 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.513186 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.513377 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.513554 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.513697 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.513833 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.513957 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.514083 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.514278 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.514466 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.514607 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.514733 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843309-3-iscsi {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.514947 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843309-3-iscsi {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.515139 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.515288 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.515422 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.515544 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.515672 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.515805 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.516068 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.516263 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.516401 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.516540 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.516672 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.516794 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.516911 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.517130 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.517319 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.517465 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.517591 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.517712 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.517832 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.518032 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.518210 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.518363 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.518500 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.518624 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.518807 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.518934 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.519072 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.519220 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.519511 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.519689 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.519820 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.519967 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.520109 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.520244 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.520406 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.520538 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.520731 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.520908 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.521059 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.521195 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.521308 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.521530 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.521668 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.521792 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.521925 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.522050 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.522170 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.522306 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.522431 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.522568 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.522693 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.522908 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.523048 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.523172 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.523303 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.523427 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.523553 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.523674 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.523794 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.523948 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.524094 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.524218 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.524347 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.524470 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.524591 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.524720 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.524922 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.525100 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.525243 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.525383 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.525505 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.525638 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.525760 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.525887 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.526085 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.526261 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.526409 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.526548 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.526672 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.526802 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.526929 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.527051 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.527347 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.527548 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.527683 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.527818 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.527982 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.528108 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.528237 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.528369 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.528493 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.528627 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.528749 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.528872 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.529089 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.529266 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.529397 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.529520 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.529641 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.529760 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.529938 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.530071 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.530260 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.530437 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.530588 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.530717 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.530864 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.530998 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.531120 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.531239 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.531366 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.531517 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.531723 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.531848 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.532000 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.532122 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.532242 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.532388 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.532513 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.532640 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.532830 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.533099 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.533236 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.533373 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.533498 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.533618 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.533737 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.533856 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.533976 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.534112 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.534244 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.534442 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.534599 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.534735 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.534877 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.534996 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.535160 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.535304 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.535461 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.535591 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.535755 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.535953 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.536091 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.536226 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.536358 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.536480 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.536695 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.536884 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.537017 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.537141 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.537263 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.537383 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.537520 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.537643 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.537811 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.537952 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.538119 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.538253 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.538442 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.538633 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.538777 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.538909 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.539034 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.539154 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.539275 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.539405 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.539560 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.539697 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.539920 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.540067 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.540202 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.540326 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.540481 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.540611 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.540813 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.540991 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.541136 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.541272 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.541407 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.541529 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.541695 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.541839 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.541971 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.542094 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.542213 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.542342 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.542490 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.542618 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.542821 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.543001 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.543227 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.543358 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.543481 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.543630 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.543760 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.543909 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.544034 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.544171 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.544302 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.544434 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.544557 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.544677 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.544797 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.544929 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.545057 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.545184 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.545385 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.545564 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.545697 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.545820 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.545941 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.546152 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:51:58.546341 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.546475 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.546599 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.546797 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.546993 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.547128 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.547252 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.547381 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.547511 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.547728 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.548109 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.548251 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.548376 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.548497 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.548625 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.548750 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.548879 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.549002 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.549128 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.549260 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.549381 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.549514 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.549636 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.549827 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.550068 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.550205 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.550319 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.550451 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.550574 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.550716 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.550849 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.551007 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.551132 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.551333 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.551466 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.551589 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.551707 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.551922 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.552051 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.552226 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.552350 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.552533 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.552658 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.552838 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.552962 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.553137 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.553362 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.553489 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.553626 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.553749 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.553869 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.554073 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.554201 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.554378 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.554503 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.554685 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.554829 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.554987 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.555112 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.555286 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.555419 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.555585 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.555717 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.555905 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.556035 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.556222 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.556360 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.556522 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.556658 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.556830 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.556963 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.557133 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.557257 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.557435 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.557566 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.557734 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.557861 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.558032 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.558158 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.558331 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.558455 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.558628 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.558751 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.558950 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.559072 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.559253 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.559378 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.559555 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.559677 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.559857 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.560006 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.560187 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.560314 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.560486 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.560610 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.560788 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.560911 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.561089 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.561214 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.561385 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.561510 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.561683 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.561809 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.561983 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.562109 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.562280 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.562406 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.562590 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.562728 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.562903 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.563027 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.563200 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.563339 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.563536 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.563670 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.563801 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.563964 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.564122 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.564268 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.564427 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.564567 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.564729 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.564867 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.565028 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.565164 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.565333 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.565468 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.565706 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.565838 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.566012 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.566146 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.566382 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.566509 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.566704 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.566837 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.567010 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.567143 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.567308 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.567435 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.567623 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.567749 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.567946 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.568074 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.568245 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.568383 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.568557 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.568682 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.568857 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.568990 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.569158 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.569283 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.569456 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.569586 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.569757 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.569891 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.570064 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.570187 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.570366 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.570490 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.570670 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.570806 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.570991 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.571115 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.571292 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.571414 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.571594 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.571732 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.571991 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.572128 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.572250 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.572376 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.572509 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.572641 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.572805 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.572931 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.573105 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.573230 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.573398 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.573538 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.573734 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.573861 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.573982 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.574101 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.574260 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.574392 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.574584 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.574720 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.574842 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.574963 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.575125 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.575249 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.575418 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.575542 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.575710 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.575833 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.576044 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.576172 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.576338 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.576475 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.576634 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.576768 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.576929 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.577054 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.577261 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.577386 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.577556 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.577689 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.577871 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.577995 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.578199 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.578323 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.578507 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.578641 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.578822 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.578952 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.579125 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.579249 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.579427 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.579632 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.579756 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.579927 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.580052 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.580174 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.580670 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.580796 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.580968 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.581091 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.581309 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.581449 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.581615 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.581741 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.581924 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.582068 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.582224 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.582351 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.582539 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.582665 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.582839 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.582963 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.583147 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.583273 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.583442 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.583577 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.583791 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.583943 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.584109 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.584234 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.584432 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.584559 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.584738 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.584864 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.585043 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.585181 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.585341 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.585466 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.585645 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.585768 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.585941 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.586073 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.586239 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.586362 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.586535 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.586658 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.586832 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.586969 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.587136 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.587261 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.587432 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.587557 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.587730 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.587864 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.588038 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.588157 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.588346 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.588469 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.588644 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.588769 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.588947 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.589070 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.589240 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.589372 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.589538 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.589663 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.589840 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.589964 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.590159 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.590291 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.590457 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.590582 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.590759 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.590916 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.591059 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.591181 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.591361 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.591494 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.591662 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.591794 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.591982 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.592119 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.592279 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.592402 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.592573 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.592706 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.592866 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.592998 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.593166 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.593291 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.593465 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.593644 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.593769 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.593985 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.594110 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.594229 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.594359 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.594479 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.594625 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.594761 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.594920 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.595052 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.595213 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.595335 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.595510 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.595642 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.595811 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.595992 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.596130 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.596260 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.596438 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.596564 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.596749 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.596941 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.597116 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.597240 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.597416 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.597574 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.597727 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.597883 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.598016 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.598201 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.598336 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.598505 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.598630 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.598829 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.598956 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.599110 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.599245 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.599406 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.599532 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.599740 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.599897 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.600074 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.600210 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.600373 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.600498 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.600675 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.600797 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.600980 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.601115 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.601281 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.601403 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.601583 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.601707 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.601884 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.602008 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.602187 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.602305 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.602489 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.602613 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.602792 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.602918 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.603090 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.603216 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.603388 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.603520 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.603688 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.603811 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.604054 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.604201 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.604333 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.604463 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.604586 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.604706 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.604886 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.605008 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.605182 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.605318 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.605481 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.605613 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.605776 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.605908 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.606078 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.606336 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.606471 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.606661 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.606933 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.607058 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.607258 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.607385 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.607564 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.607688 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.607891 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.608017 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.608221 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.608346 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.608505 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.608631 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.608833 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.608957 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.609128 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.609265 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.609428 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.609555 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.609724 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.609863 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.610020 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.610145 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.610320 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.610454 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.610615 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.610746 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.610906 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.611038 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.611200 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.611325 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.611496 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.611622 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.611788 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.611933 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.612112 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.612237 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.612403 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.612729 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.612860 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.612981 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.613115 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.613246 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.613369 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.613489 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.613649 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.613786 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.613942 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.614073 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.614277 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.614413 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.614536 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.614665 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.614821 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.614946 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.615113 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.615245 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.615408 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.615543 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.615700 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.615825 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.616091 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.616219 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.616426 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.616562 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.616721 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.616855 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.617046 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.617171 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.617346 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.617471 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.617642 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.617768 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.617958 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.618085 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.618254 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.618389 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.618549 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.618685 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.618843 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.618971 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.619136 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.619268 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.619432 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.619556 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.619723 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.619855 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.620047 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.620171 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.620342 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.620466 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.620639 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.620770 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.620937 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.621062 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.621234 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.621357 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.621533 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.621665 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.621826 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.621949 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.622123 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.622250 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.622419 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.622558 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.622707 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.622832 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.623001 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.623126 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.623293 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.623419 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.623602 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.623732 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.623919 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.624047 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.624186 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.624395 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.624519 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.624649 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.624771 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.624890 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.625045 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.625171 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.625338 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.625461 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.625630 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.625755 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.625925 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.626057 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.626221 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.626355 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.626513 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.626635 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.626811 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.626935 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.627106 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.627231 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.627399 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.627539 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.627693 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.627818 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.628014 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.628193 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.628353 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.628495 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.628661 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.628787 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.628960 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.629084 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.629253 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.629387 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.629553 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.629679 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.629867 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.630023 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.630180 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.630316 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.630477 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.630603 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.630777 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.630904 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.631104 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.631230 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.631359 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.631481 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.631634 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.631759 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.631938 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.632076 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.632253 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.632410 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.632535 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.632671 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.632803 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.632926 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.633082 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.633216 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.633375 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.633499 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.633671 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.633796 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.633967 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.634099 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.634259 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.634406 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.634594 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.634720 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.634841 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.634962 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.635153 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.635289 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.635448 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.635572 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.635772 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.635918 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.636106 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.636244 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.636404 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.636527 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.636708 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.636834 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.637008 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.637145 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.637300 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.637429 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.637605 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.637733 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.637901 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.638027 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.638202 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.638324 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.638498 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.638622 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.638792 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.638919 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.639086 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.639210 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.639381 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.639506 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.639679 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.639803 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.640003 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.640128 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.640303 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.640429 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.640614 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.640739 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.640910 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.641044 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.641213 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.641347 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.641508 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.641631 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.641803 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.641927 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.642100 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.642233 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.642397 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.642522 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.642695 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.642818 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.642995 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.643132 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.643293 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.643416 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.643590 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.643713 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.643930 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.644070 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.644235 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.644361 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.644537 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.644738 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.644872 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.644995 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.645125 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.645248 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.645407 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.645533 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.645704 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.645830 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.646022 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.646147 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.646325 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.646450 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.646620 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.646745 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.646922 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.647048 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.647219 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.647348 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.647520 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.647646 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.647816 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.648013 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.648313 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.648451 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.648611 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.648735 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.648912 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.649043 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.649212 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.649345 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.649514 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.649638 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.649818 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.649942 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.650118 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.650256 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.650423 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.650555 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.650721 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.650854 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.651116 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.651248 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.651421 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.651561 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.651717 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.651850 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.652077 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.652199 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.652320 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.652448 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.652605 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.652725 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.652906 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.653032 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.653201 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.653324 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.653499 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.653625 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.653795 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.653929 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.654092 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.654217 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.654400 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.654524 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.654694 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.654894 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.655018 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.655147 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.655384 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.655521 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.655693 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.655823 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.656004 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.656128 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.656386 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.656518 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.656697 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.656820 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.656998 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.657122 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.657310 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.657441 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.657607 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.657732 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.657912 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.658059 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.658190 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.658311 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.658502 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.658640 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.658806 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.658931 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.659105 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.659228 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.659490 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.659629 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.659795 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.659951 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.660125 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.660256 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.660443 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.660576 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.660749 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.660874 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.661069 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.661193 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.661416 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.661548 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.661734 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.661867 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.662069 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.662194 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.662382 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.662509 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.662700 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.662824 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.663001 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.663126 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.663298 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.663425 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.663601 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.663734 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.663919 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.664068 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.664213 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.664336 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.664510 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.664634 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.664805 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.665018 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.665146 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.665277 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.665399 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.665520 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.665683 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.665817 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.665981 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.666106 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.666272 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.666392 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.666567 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.666702 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.666862 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.666995 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.667171 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.667295 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.667463 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.667587 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.667775 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.667920 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.668103 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.668228 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.668398 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.668539 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.668715 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.668840 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.669013 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.669137 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.669314 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.669438 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.669587 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.669712 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.669884 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.670009 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.670181 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.670320 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.670479 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.670612 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.670796 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.670929 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.671097 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.671220 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.671409 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.671543 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.671719 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.671859 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.672065 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.672190 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.672371 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.672506 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.672678 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.672817 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.672990 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.673114 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.673662 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.673662 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.673916 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.674047 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.674177 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.674299 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.674420 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.674541 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.674678 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.674801 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.674930 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.675210 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.675335 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.675457 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.675589 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.675711 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.675907 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.676038 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.676212 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.676337 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.676544 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.676672 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.676793 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.676913 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.677086 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.677212 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.677392 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.677526 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.677689 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.677822 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.677986 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.678126 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.678282 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.678415 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.678614 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.678741 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.678911 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.679050 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.679212 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.679349 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.679511 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.679637 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.679830 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.680011 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.680190 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.680316 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.680494 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.680619 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.680813 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.680953 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.681129 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.681252 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.681436 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.681559 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.681739 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.681873 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.682042 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.682165 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.682352 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.682476 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.682659 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.682784 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.682965 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.683082 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.683262 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.683385 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.683586 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.683710 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.683859 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.684070 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.684204 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.684325 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.684456 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.684684 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.684810 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.685011 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.685136 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.685344 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.685470 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.685622 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.685844 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.685976 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.686168 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.686302 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.686478 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.686596 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.686786 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.686912 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.687091 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.687226 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.687390 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.687513 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.687694 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.687820 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.688020 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.688147 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.688329 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.688433 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.688632 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.688733 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.688934 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.689036 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.689256 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.689353 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.689565 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.689654 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.689873 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.689964 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.690179 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.690269 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.690494 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.690591 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.690845 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.690935 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.691147 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.691236 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.691453 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.691553 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.691761 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.691898 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.692093 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.692204 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.692397 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.692496 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.692701 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.692805 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.693006 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.693109 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.693316 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.693417 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.693619 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.693710 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.693922 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.694010 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.694229 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.694328 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.694532 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.694629 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.694837 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.694939 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.695138 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.695226 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.695442 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.695531 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.695746 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.695844 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.696073 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.696181 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.696379 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.696468 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.696702 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.696883 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.697010 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.697188 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.697316 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.697512 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.697617 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.697829 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.698118 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.698208 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.698432 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.698521 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.698736 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.698832 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.699053 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.699142 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.699351 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.699438 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.699648 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.699738 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.699971 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.700075 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.700275 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.700365 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.700572 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.700662 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.700869 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.700958 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.701172 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.701279 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.701463 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.701551 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.701760 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.701846 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.702059 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.702154 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.702363 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.702576 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.702663 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.702913 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.703002 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.703219 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.703330 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.703535 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.703747 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.703836 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.704114 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.704222 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.704423 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.704520 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.704740 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.704830 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.705044 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.705132 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.705685 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.705782 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.705984 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.706087 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.706357 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.706457 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.706631 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.706735 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.706933 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.707100 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.707237 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.707412 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.707541 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.707717 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.707840 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.708043 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.708168 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.708349 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.708467 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.708653 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.708786 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.708956 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.709084 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.709255 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.709391 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.709559 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.709679 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.709857 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.709982 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.710174 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.710283 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.710474 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.710562 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.710773 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.710863 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.711070 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.711160 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.711372 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.711470 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.711673 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.711763 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.712014 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.712119 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.712308 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.712478 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.712603 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.712692 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.712896 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.712982 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.713187 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.713284 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.713487 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.713582 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.713783 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.713871 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.714085 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.714183 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.714382 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.714473 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.714682 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.714779 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.714982 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.715083 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.715295 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.715391 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.715599 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.715697 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.715921 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.716016 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.716222 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.716313 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.716525 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.716623 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.716841 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.717044 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.717141 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.717373 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.717462 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.717685 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.717783 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.718018 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.718128 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.718345 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.718557 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.718650 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.718884 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.718976 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.719196 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.719287 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.719517 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.719617 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.719821 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.719941 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.720153 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.720242 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.720454 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.720555 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.720751 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.720840 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.721050 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.721140 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.721352 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.721452 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.721653 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.721743 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.722076 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.722181 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.722384 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.722517 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.722661 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.722750 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.722923 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.723015 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.723219 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.723309 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.723516 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.723626 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.723815 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.723937 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.724141 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.724232 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.724441 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.724531 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.724739 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.724840 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.725037 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.725137 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.725341 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.725484 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.725628 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.725774 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.726015 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.726154 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.726316 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.726454 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.726610 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.726756 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.726894 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.727060 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.727203 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.727344 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.727479 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.727623 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.727767 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.727938 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.728083 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.728219 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.728367 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.728514 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.728651 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.728788 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.728923 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.729058 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.729203 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.729347 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.729528 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.729670 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.729843 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.729995 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.730141 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.730289 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.730426 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.730561 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.730736 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.730886 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.731051 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.731195 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.731365 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.731508 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.731654 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.731804 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.732038 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.732145 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.732307 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.732441 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.732606 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.732758 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.732858 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.732942 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.733180 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.733316 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.733464 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.733566 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.733791 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.733926 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.734096 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.734230 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.734343 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.734437 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.734665 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.734800 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.734961 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.735095 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.735207 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.735293 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.735527 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.735661 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.735825 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.736021 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.736148 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.736236 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.736390 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.736488 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.736680 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.736834 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.736972 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.737106 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.737241 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.737375 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.737679 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.737848 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.737988 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.738123 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.738266 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.738402 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.738546 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.738691 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.738837 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.738974 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.739110 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.739252 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.739389 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.739532 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.739684 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.739828 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.739998 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.740138 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.740361 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.740499 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.740635 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.740770 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.740905 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.741039 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.741183 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.741318 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.741452 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.741598 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.741734 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.741869 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.742013 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.742149 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.742291 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.742427 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.742590 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.742743 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.742882 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.743024 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.743197 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.743349 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.743497 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.743642 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.743812 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.744008 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.744156 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.744292 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.744427 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.744571 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.744707 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.744843 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.744980 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.745114 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.745271 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.745423 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.745566 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.745708 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.745853 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.746012 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.746239 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.746389 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.746532 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.746675 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.746817 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.746959 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.747125 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.747276 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.747419 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.747568 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.747726 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.747918 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.748084 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.748229 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.748371 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.748512 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.748654 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.748804 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.748948 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.749109 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.749253 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.749395 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.749536 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.749687 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.749830 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.749972 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.750115 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.750256 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.750398 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.750553 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.750705 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.750859 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.751009 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.751152 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.751152 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.751431 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.751586 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.751729 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.751897 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.752046 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.752205 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.752350 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.752504 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.752646 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.752798 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.752940 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.753118 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.753270 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.753413 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.753566 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.753772 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 09:51:58.754012 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.754012 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.754297 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.754520 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.754819 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:51:58.755054 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 09:51:58.911092 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: INFO dbcounter [None req-8420ca31-c5a7-41c4-b721-69db300dcb56 None None] Registered counter for database nova_api Jun 30 09:51:58.913398 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: INFO dbcounter [None req-ef761c9b-957e-4da6-8e0c-dc19151fdd79 None None] Registered counter for database nova_api Jun 30 09:51:58.935321 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG oslo_db.sqlalchemy.engines [None req-8420ca31-c5a7-41c4-b721-69db300dcb56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103119) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 09:51:58.937093 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG oslo_db.sqlalchemy.engines [None req-ef761c9b-957e-4da6-8e0c-dc19151fdd79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103118) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 09:51:58.942565 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG dbcounter [-] [103119] Writer thread running {{(pid=103119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 09:51:58.943924 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG dbcounter [-] [103118] Writer thread running {{(pid=103118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 09:51:58.997384 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.context [None req-8420ca31-c5a7-41c4-b721-69db300dcb56 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c89fa87a-864c-4617-9f03-4ca146aad90b(cell1) {{(pid=103119) load_cells /opt/stack/nova/nova/context.py:464}} Jun 30 09:51:58.998651 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.context [None req-ef761c9b-957e-4da6-8e0c-dc19151fdd79 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c89fa87a-864c-4617-9f03-4ca146aad90b(cell1) {{(pid=103118) load_cells /opt/stack/nova/nova/context.py:464}} Jun 30 09:51:59.001303 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG oslo_concurrency.lockutils [None req-8420ca31-c5a7-41c4-b721-69db300dcb56 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 09:51:59.002600 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG oslo_concurrency.lockutils [None req-ef761c9b-957e-4da6-8e0c-dc19151fdd79 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 09:51:59.002885 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG oslo_concurrency.lockutils [None req-8420ca31-c5a7-41c4-b721-69db300dcb56 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 09:51:59.003687 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG oslo_concurrency.lockutils [None req-8420ca31-c5a7-41c4-b721-69db300dcb56 None None] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 09:51:59.004381 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG oslo_concurrency.lockutils [None req-ef761c9b-957e-4da6-8e0c-dc19151fdd79 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 09:51:59.005158 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG oslo_concurrency.lockutils [None req-ef761c9b-957e-4da6-8e0c-dc19151fdd79 None None] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 09:51:59.005635 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG oslo_concurrency.lockutils [None req-8420ca31-c5a7-41c4-b721-69db300dcb56 None None] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 09:51:59.007080 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG oslo_concurrency.lockutils [None req-ef761c9b-957e-4da6-8e0c-dc19151fdd79 None None] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 09:51:59.007623 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: INFO dbcounter [None req-8420ca31-c5a7-41c4-b721-69db300dcb56 None None] Registered counter for database nova_cell0 Jun 30 09:51:59.009059 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: INFO dbcounter [None req-ef761c9b-957e-4da6-8e0c-dc19151fdd79 None None] Registered counter for database nova_cell0 Jun 30 09:51:59.013039 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: INFO dbcounter [None req-8420ca31-c5a7-41c4-b721-69db300dcb56 None None] Registered counter for database nova_cell1 Jun 30 09:51:59.014375 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: INFO dbcounter [None req-ef761c9b-957e-4da6-8e0c-dc19151fdd79 None None] Registered counter for database nova_cell1 Jun 30 09:51:59.021012 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG oslo_db.sqlalchemy.engines [None req-8420ca31-c5a7-41c4-b721-69db300dcb56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103119) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 09:51:59.022940 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG oslo_db.sqlalchemy.engines [None req-8420ca31-c5a7-41c4-b721-69db300dcb56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103119) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 09:51:59.024807 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG oslo_db.sqlalchemy.engines [None req-ef761c9b-957e-4da6-8e0c-dc19151fdd79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103118) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 09:51:59.029102 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG oslo_db.sqlalchemy.engines [None req-ef761c9b-957e-4da6-8e0c-dc19151fdd79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103118) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 09:51:59.029909 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG dbcounter [-] [103119] Writer thread running {{(pid=103119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 09:51:59.035215 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG dbcounter [-] [103119] Writer thread running {{(pid=103119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 09:51:59.035329 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG dbcounter [-] [103118] Writer thread running {{(pid=103118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 09:51:59.038192 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG dbcounter [-] [103118] Writer thread running {{(pid=103118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 09:51:59.172133 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: INFO dbcounter [None req-8420ca31-c5a7-41c4-b721-69db300dcb56 None None] Registered counter for database nova_cell0 Jun 30 09:51:59.181228 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG oslo_db.sqlalchemy.engines [None req-8420ca31-c5a7-41c4-b721-69db300dcb56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103119) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 09:51:59.184090 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: INFO dbcounter [None req-ef761c9b-957e-4da6-8e0c-dc19151fdd79 None None] Registered counter for database nova_cell0 Jun 30 09:51:59.186516 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG dbcounter [-] [103119] Writer thread running {{(pid=103119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 09:51:59.191847 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG oslo_db.sqlalchemy.engines [None req-ef761c9b-957e-4da6-8e0c-dc19151fdd79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103118) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 09:51:59.196136 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG dbcounter [-] [103118] Writer thread running {{(pid=103118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 09:51:59.520853 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: WARNING keystonemiddleware.auth_token [None req-ef761c9b-957e-4da6-8e0c-dc19151fdd79 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 09:51:59.521538 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: WARNING keystonemiddleware.auth_token [None req-8420ca31-c5a7-41c4-b721-69db300dcb56 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 09:51:59.528006 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: WARNING keystonemiddleware.auth_token [None req-ef761c9b-957e-4da6-8e0c-dc19151fdd79 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 09:51:59.528422 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: WARNING keystonemiddleware.auth_token [None req-8420ca31-c5a7-41c4-b721-69db300dcb56 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 09:51:59.869014 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: WARNING keystonemiddleware.auth_token [None req-8420ca31-c5a7-41c4-b721-69db300dcb56 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 09:51:59.869680 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: WARNING keystonemiddleware.auth_token [None req-ef761c9b-957e-4da6-8e0c-dc19151fdd79 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 09:51:59.875019 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: WARNING keystonemiddleware.auth_token [None req-8420ca31-c5a7-41c4-b721-69db300dcb56 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 09:51:59.875567 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: WARNING keystonemiddleware.auth_token [None req-ef761c9b-957e-4da6-8e0c-dc19151fdd79 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 09:51:59.880376 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561aa59a29c0 pid: 103119 (default app) Jun 30 09:51:59.880993 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561aa59a29c0 pid: 103118 (default app) Jun 30 09:51:59.882470 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi [None req-8420ca31-c5a7-41c4-b721-69db300dcb56 None None] Calling method '>' {{(pid=103119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:51:59.883675 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: INFO nova.api.openstack.requestlog [None req-8420ca31-c5a7-41c4-b721-69db300dcb56 None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001746 Jun 30 09:51:59.884118 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: [pid: 103119|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 788 bytes} [Thu Jun 30 09:51:59 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 09:53:15.350410 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi [None req-ef761c9b-957e-4da6-8e0c-dc19151fdd79 None None] Calling method '>' {{(pid=103118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:53:15.351619 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: INFO nova.api.openstack.requestlog [None req-ef761c9b-957e-4da6-8e0c-dc19151fdd79 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002011 Jun 30 09:53:15.352412 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: [pid: 103118|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 930 bytes} [Thu Jun 30 09:53:15 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 09:53:15.364527 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG dbcounter [-] [103119] Writing DB stats nova_api:SELECT=3 {{(pid=103119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 09:53:15.365515 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG dbcounter [-] [103119] Writing DB stats nova_cell1:SELECT=3 {{(pid=103119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 09:53:15.366338 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG dbcounter [-] [103119] Writing DB stats nova_cell0:SELECT=3 {{(pid=103119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 09:53:15.367043 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG dbcounter [-] [103119] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 09:53:15.789747 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi [None req-1f34e64c-9650-4cbb-8698-e41039177ad5 admin admin] Calling method '>' {{(pid=103119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:53:15.819735 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: INFO nova.api.openstack.requestlog [None req-1f34e64c-9650-4cbb-8698-e41039177ad5 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.461329 Jun 30 09:53:15.823960 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: [pid: 103119|app: 0|req: 2/3] 10.222.0.16 () {60 vars in 1291 bytes} [Thu Jun 30 09:53:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 09:53:17.888624 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi [None req-ef761c9b-957e-4da6-8e0c-dc19151fdd79 None None] Calling method '>' {{(pid=103118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:53:17.889622 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: INFO nova.api.openstack.requestlog [None req-ef761c9b-957e-4da6-8e0c-dc19151fdd79 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jun 30 09:53:17.889977 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: [pid: 103118|app: 0|req: 2/4] 10.222.0.16 () {54 vars in 930 bytes} [Thu Jun 30 09:53:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 09:53:17.955463 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi [None req-f9b4ba48-be23-4273-8219-5389e56b6e78 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 1, "vcpus": 1, "id": "c1", "os-flavor-access:is_public": true, "ram": 256, "name": "cirros256", "swap": 0}} {{(pid=103119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 09:53:17.975127 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 09:53:17.975127 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: warnings.warn(msg) Jun 30 09:53:18.007999 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: INFO nova.api.openstack.requestlog [None req-f9b4ba48-be23-4273-8219-5389e56b6e78 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.111933 Jun 30 09:53:18.008522 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: [pid: 103119|app: 0|req: 3/5] 10.222.0.16 () {64 vars in 1282 bytes} [Thu Jun 30 09:53:17 2022] POST /compute/v2.1/flavors => generated 407 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 09:53:18.024544 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG dbcounter [-] [103118] Writing DB stats nova_api:SELECT=3 {{(pid=103118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 09:53:18.026324 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG dbcounter [-] [103118] Writing DB stats nova_cell0:SELECT=3 {{(pid=103118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 09:53:18.027707 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG dbcounter [-] [103118] Writing DB stats nova_cell1:SELECT=3 {{(pid=103118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 09:53:18.028873 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG dbcounter [-] [103118] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 09:53:18.259710 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi [None req-6ed88e65-d60b-41a6-8327-816daba3f148 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 09:53:18.262412 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 09:53:18.262412 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: warnings.warn(msg) Jun 30 09:53:18.340549 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: INFO nova.api.openstack.requestlog [None req-6ed88e65-d60b-41a6-8327-816daba3f148 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.323254 Jun 30 09:53:18.342797 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: [pid: 103118|app: 0|req: 3/6] 10.222.0.16 () {64 vars in 1335 bytes} [Thu Jun 30 09:53:18 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 09:53:20.434647 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi [None req-f9b4ba48-be23-4273-8219-5389e56b6e78 admin admin] Calling method '>' {{(pid=103119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:53:20.435653 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: INFO nova.api.openstack.requestlog [None req-f9b4ba48-be23-4273-8219-5389e56b6e78 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jun 30 09:53:20.436095 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: [pid: 103119|app: 0|req: 4/7] 10.222.0.16 () {54 vars in 930 bytes} [Thu Jun 30 09:53:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 09:53:20.559408 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi [None req-2a871818-0934-43f3-8f87-5de0ab6058cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d1", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "disk": 5, "ram": 512, "os-flavor-access:is_public": true}} {{(pid=103118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 09:53:20.577242 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 09:53:20.577242 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: warnings.warn(msg) Jun 30 09:53:20.597777 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: INFO nova.api.openstack.requestlog [None req-2a871818-0934-43f3-8f87-5de0ab6058cc admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.155986 Jun 30 09:53:20.598337 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: [pid: 103118|app: 0|req: 4/8] 10.222.0.16 () {64 vars in 1282 bytes} [Thu Jun 30 09:53:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 09:53:20.610329 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi [None req-e2c7e9cc-1d01-4123-9001-14c5a9196c65 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 09:53:20.612154 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 09:53:20.612154 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: warnings.warn(msg) Jun 30 09:53:20.649292 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: INFO nova.api.openstack.requestlog [None req-e2c7e9cc-1d01-4123-9001-14c5a9196c65 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042697 Jun 30 09:53:20.649910 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: [pid: 103119|app: 0|req: 5/9] 10.222.0.16 () {64 vars in 1335 bytes} [Thu Jun 30 09:53:20 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 09:53:22.744189 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi [None req-2a871818-0934-43f3-8f87-5de0ab6058cc admin admin] Calling method '>' {{(pid=103118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:53:22.745321 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: INFO nova.api.openstack.requestlog [None req-2a871818-0934-43f3-8f87-5de0ab6058cc admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Jun 30 09:53:22.745784 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: [pid: 103118|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 930 bytes} [Thu Jun 30 09:53:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 09:53:22.810039 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi [None req-040fc268-3e2c-49f8-8518-69b88b9cda86 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d2", "os-flavor-access:is_public": true, "name": "ds1G", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "rxtx_factor": 1.0, "disk": 10}} {{(pid=103119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 09:53:22.829424 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: INFO nova.api.openstack.requestlog [None req-040fc268-3e2c-49f8-8518-69b88b9cda86 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077965 Jun 30 09:53:22.829955 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: [pid: 103119|app: 0|req: 6/11] 10.222.0.16 () {64 vars in 1282 bytes} [Thu Jun 30 09:53:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 09:53:22.842550 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi [None req-1750d611-ed25-4288-bb9f-4f917e9da1de admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 09:53:22.866768 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: INFO nova.api.openstack.requestlog [None req-1750d611-ed25-4288-bb9f-4f917e9da1de admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028500 Jun 30 09:53:22.867719 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: [pid: 103118|app: 0|req: 6/12] 10.222.0.16 () {64 vars in 1335 bytes} [Thu Jun 30 09:53:22 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 09:53:24.914765 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi [None req-040fc268-3e2c-49f8-8518-69b88b9cda86 admin admin] Calling method '>' {{(pid=103119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:53:24.915935 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: INFO nova.api.openstack.requestlog [None req-040fc268-3e2c-49f8-8518-69b88b9cda86 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001580 Jun 30 09:53:24.916397 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: [pid: 103119|app: 0|req: 7/13] 10.222.0.16 () {54 vars in 930 bytes} [Thu Jun 30 09:53:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 09:53:24.977142 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi [None req-2d7b3c5a-2790-4df9-8714-d257eb2bebef admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "id": "d3", "name": "ds2G", "swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10}} {{(pid=103118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 09:53:24.996132 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: INFO nova.api.openstack.requestlog [None req-2d7b3c5a-2790-4df9-8714-d257eb2bebef admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073963 Jun 30 09:53:24.996702 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: [pid: 103118|app: 0|req: 7/14] 10.222.0.16 () {64 vars in 1282 bytes} [Thu Jun 30 09:53:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 09:53:25.009128 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi [None req-9f0f4c30-116d-4aba-bda5-adedde1c15f2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 09:53:25.033422 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: INFO nova.api.openstack.requestlog [None req-9f0f4c30-116d-4aba-bda5-adedde1c15f2 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028184 Jun 30 09:53:25.034479 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: [pid: 103119|app: 0|req: 8/15] 10.222.0.16 () {64 vars in 1335 bytes} [Thu Jun 30 09:53:25 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 09:53:27.113397 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi [None req-2d7b3c5a-2790-4df9-8714-d257eb2bebef admin admin] Calling method '>' {{(pid=103118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:53:27.114992 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: INFO nova.api.openstack.requestlog [None req-2d7b3c5a-2790-4df9-8714-d257eb2bebef admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002168 Jun 30 09:53:27.121094 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: [pid: 103118|app: 0|req: 8/16] 10.222.0.16 () {54 vars in 930 bytes} [Thu Jun 30 09:53:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 09:53:27.179530 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi [None req-aa0b9f70-7198-4ea7-896e-6a321a36175b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "id": "d4", "os-flavor-access:is_public": true, "vcpus": 4, "disk": 20, "swap": 0, "rxtx_factor": 1.0, "ram": 4096}} {{(pid=103119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 09:53:27.198819 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: INFO nova.api.openstack.requestlog [None req-aa0b9f70-7198-4ea7-896e-6a321a36175b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071974 Jun 30 09:53:27.199818 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: [pid: 103119|app: 0|req: 9/17] 10.222.0.16 () {64 vars in 1282 bytes} [Thu Jun 30 09:53:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 09:53:27.211910 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi [None req-ecdf6331-fa9f-4a59-a6dc-0d06cf2b784e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 09:53:27.234754 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: INFO nova.api.openstack.requestlog [None req-ecdf6331-fa9f-4a59-a6dc-0d06cf2b784e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026565 Jun 30 09:53:27.235398 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: [pid: 103118|app: 0|req: 9/18] 10.222.0.16 () {64 vars in 1335 bytes} [Thu Jun 30 09:53:27 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 09:53:29.362063 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi [None req-aa0b9f70-7198-4ea7-896e-6a321a36175b admin admin] Calling method '>' {{(pid=103119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:53:29.364161 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: INFO nova.api.openstack.requestlog [None req-aa0b9f70-7198-4ea7-896e-6a321a36175b admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002625 Jun 30 09:53:29.364534 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: [pid: 103119|app: 0|req: 10/19] 10.222.0.16 () {54 vars in 930 bytes} [Thu Jun 30 09:53:29 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 09:53:29.425165 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi [None req-a1cb8832-06ff-4a4e-86ff-04fd5f11ac3e admin admin] Calling method '>' {{(pid=103118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:53:29.450408 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: INFO nova.api.openstack.requestlog [None req-a1cb8832-06ff-4a4e-86ff-04fd5f11ac3e admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.078980 Jun 30 09:53:29.451264 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: [pid: 103118|app: 0|req: 10/20] 10.222.0.16 () {60 vars in 1291 bytes} [Thu Jun 30 09:53:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 09:53:31.581080 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi [None req-aa0b9f70-7198-4ea7-896e-6a321a36175b admin admin] Calling method '>' {{(pid=103119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:53:31.582087 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: INFO nova.api.openstack.requestlog [None req-aa0b9f70-7198-4ea7-896e-6a321a36175b admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001625 Jun 30 09:53:31.582484 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: [pid: 103119|app: 0|req: 11/21] 10.222.0.16 () {54 vars in 930 bytes} [Thu Jun 30 09:53:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 09:53:31.646557 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi [None req-15b2ee9b-3e02-4241-863c-b468ebb58857 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "1", "name": "m1.tiny", "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "os-flavor-access:is_public": true, "ram": 512}} {{(pid=103118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 09:53:31.667032 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: INFO nova.api.openstack.requestlog [None req-15b2ee9b-3e02-4241-863c-b468ebb58857 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.078530 Jun 30 09:53:31.667577 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: [pid: 103118|app: 0|req: 11/22] 10.222.0.16 () {64 vars in 1282 bytes} [Thu Jun 30 09:53:31 2022] POST /compute/v2.1/flavors => generated 402 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 09:53:31.679664 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi [None req-c7eff0c1-2741-4dcb-8119-dd85bbe102dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 09:53:31.707140 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: INFO nova.api.openstack.requestlog [None req-c7eff0c1-2741-4dcb-8119-dd85bbe102dc admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031153 Jun 30 09:53:31.707728 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: [pid: 103119|app: 0|req: 12/23] 10.222.0.16 () {64 vars in 1332 bytes} [Thu Jun 30 09:53:31 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 09:53:33.847522 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi [None req-15b2ee9b-3e02-4241-863c-b468ebb58857 admin admin] Calling method '>' {{(pid=103118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:53:33.848794 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: INFO nova.api.openstack.requestlog [None req-15b2ee9b-3e02-4241-863c-b468ebb58857 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001931 Jun 30 09:53:33.849469 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: [pid: 103118|app: 0|req: 12/24] 10.222.0.16 () {54 vars in 930 bytes} [Thu Jun 30 09:53:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 09:53:33.910452 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi [None req-f7d199e3-b87b-4d0b-b6f2-c71009234f0c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 2048, "name": "m1.small", "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "disk": 20}} {{(pid=103119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 09:53:33.930651 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: INFO nova.api.openstack.requestlog [None req-f7d199e3-b87b-4d0b-b6f2-c71009234f0c admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.075536 Jun 30 09:53:33.931187 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: [pid: 103119|app: 0|req: 13/25] 10.222.0.16 () {64 vars in 1282 bytes} [Thu Jun 30 09:53:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 09:53:33.944181 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi [None req-d0c37a80-49c0-4b12-b085-f714b1632b01 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 09:53:33.969330 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: INFO nova.api.openstack.requestlog [None req-d0c37a80-49c0-4b12-b085-f714b1632b01 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029738 Jun 30 09:53:33.969913 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: [pid: 103118|app: 0|req: 13/26] 10.222.0.16 () {64 vars in 1332 bytes} [Thu Jun 30 09:53:33 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 09:53:36.448122 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi [None req-f7d199e3-b87b-4d0b-b6f2-c71009234f0c admin admin] Calling method '>' {{(pid=103119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:53:36.449162 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: INFO nova.api.openstack.requestlog [None req-f7d199e3-b87b-4d0b-b6f2-c71009234f0c admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jun 30 09:53:36.449572 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: [pid: 103119|app: 0|req: 14/27] 10.222.0.16 () {54 vars in 930 bytes} [Thu Jun 30 09:53:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 09:53:36.509663 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi [None req-2c9907bc-6b9f-4002-bdb3-c8c58e961d48 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "os-flavor-access:is_public": true, "swap": 0, "ram": 4096, "vcpus": 2, "disk": 40, "rxtx_factor": 1.0}} {{(pid=103118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 09:53:36.529174 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: INFO nova.api.openstack.requestlog [None req-2c9907bc-6b9f-4002-bdb3-c8c58e961d48 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.072271 Jun 30 09:53:36.529726 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: [pid: 103118|app: 0|req: 14/28] 10.222.0.16 () {64 vars in 1282 bytes} [Thu Jun 30 09:53:36 2022] POST /compute/v2.1/flavors => generated 406 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 09:53:36.541856 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi [None req-17cafc60-0c0c-4dad-b3fc-3e3b5860b41a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 09:53:36.566354 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: INFO nova.api.openstack.requestlog [None req-17cafc60-0c0c-4dad-b3fc-3e3b5860b41a admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028112 Jun 30 09:53:36.566862 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: [pid: 103119|app: 0|req: 15/29] 10.222.0.16 () {64 vars in 1332 bytes} [Thu Jun 30 09:53:36 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 09:53:38.613584 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi [None req-2c9907bc-6b9f-4002-bdb3-c8c58e961d48 admin admin] Calling method '>' {{(pid=103118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:53:38.614769 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: INFO nova.api.openstack.requestlog [None req-2c9907bc-6b9f-4002-bdb3-c8c58e961d48 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001663 Jun 30 09:53:38.615143 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: [pid: 103118|app: 0|req: 15/30] 10.222.0.16 () {54 vars in 930 bytes} [Thu Jun 30 09:53:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 09:53:38.674980 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi [None req-4634e7fa-9841-4359-9b4e-778cd75fe87e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "swap": 0, "rxtx_factor": 1.0, "vcpus": 4, "id": "4", "os-flavor-access:is_public": true, "ram": 8192, "name": "m1.large"}} {{(pid=103119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 09:53:38.693879 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: INFO nova.api.openstack.requestlog [None req-4634e7fa-9841-4359-9b4e-778cd75fe87e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072995 Jun 30 09:53:38.694440 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: [pid: 103119|app: 0|req: 16/31] 10.222.0.16 () {64 vars in 1282 bytes} [Thu Jun 30 09:53:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 09:53:38.707546 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi [None req-be6cef5e-f57b-41b0-9ae3-262c3ada9d3b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 09:53:38.731906 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: INFO nova.api.openstack.requestlog [None req-be6cef5e-f57b-41b0-9ae3-262c3ada9d3b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028830 Jun 30 09:53:38.732452 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: [pid: 103118|app: 0|req: 16/32] 10.222.0.16 () {64 vars in 1332 bytes} [Thu Jun 30 09:53:38 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 09:53:40.825470 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi [None req-4634e7fa-9841-4359-9b4e-778cd75fe87e admin admin] Calling method '>' {{(pid=103119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:53:40.827118 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: INFO nova.api.openstack.requestlog [None req-4634e7fa-9841-4359-9b4e-778cd75fe87e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002088 Jun 30 09:53:40.828076 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: [pid: 103119|app: 0|req: 17/33] 10.222.0.16 () {54 vars in 930 bytes} [Thu Jun 30 09:53:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 09:53:40.892342 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi [None req-9de73ed0-7a16-44f0-89db-5081f292a107 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "swap": 0, "disk": 160, "vcpus": 8, "rxtx_factor": 1.0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "ram": 16384}} {{(pid=103118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 09:53:40.910884 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: INFO nova.api.openstack.requestlog [None req-9de73ed0-7a16-44f0-89db-5081f292a107 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.076344 Jun 30 09:53:40.911439 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: [pid: 103118|app: 0|req: 17/34] 10.222.0.16 () {64 vars in 1282 bytes} [Thu Jun 30 09:53:40 2022] POST /compute/v2.1/flavors => generated 408 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 09:53:40.923593 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi [None req-4683ab3f-68ab-4644-9c99-669e5f2674af admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 09:53:40.948554 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: INFO nova.api.openstack.requestlog [None req-4683ab3f-68ab-4644-9c99-669e5f2674af admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028783 Jun 30 09:53:40.949347 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: [pid: 103119|app: 0|req: 18/35] 10.222.0.16 () {64 vars in 1332 bytes} [Thu Jun 30 09:53:40 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 09:54:05.372451 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi [None req-9de73ed0-7a16-44f0-89db-5081f292a107 admin admin] Calling method '>' {{(pid=103118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:54:05.373462 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: INFO nova.api.openstack.requestlog [None req-9de73ed0-7a16-44f0-89db-5081f292a107 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jun 30 09:54:05.373855 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: [pid: 103118|app: 0|req: 18/36] 10.222.0.16 () {54 vars in 930 bytes} [Thu Jun 30 09:54:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 09:54:05.388553 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG dbcounter [-] [103119] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 09:54:05.439522 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi [None req-ddf6e29b-0d87-4dd0-92a2-aed09fb0d080 admin admin] Calling method '>' {{(pid=103119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:54:05.457433 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: INFO nova.api.openstack.requestlog [None req-ddf6e29b-0d87-4dd0-92a2-aed09fb0d080 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.076621 Jun 30 09:54:05.457971 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: [pid: 103119|app: 0|req: 19/37] 10.222.0.16 () {60 vars in 1291 bytes} [Thu Jun 30 09:54:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 09:54:06.414905 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi [None req-9de73ed0-7a16-44f0-89db-5081f292a107 admin admin] Calling method '>' {{(pid=103118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:54:06.416255 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: INFO nova.api.openstack.requestlog [None req-9de73ed0-7a16-44f0-89db-5081f292a107 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001858 Jun 30 09:54:06.416811 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: [pid: 103118|app: 0|req: 19/38] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Jun 30 09:54:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 09:54:06.616655 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi [None req-75e8c36a-3b22-4d1f-a6ca-0145206c0630 admin admin] Calling method '>' {{(pid=103119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:54:06.622250 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: INFO nova.api.openstack.wsgi [None req-75e8c36a-3b22-4d1f-a6ca-0145206c0630 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 30 09:54:06.625536 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi [None req-75e8c36a-3b22-4d1f-a6ca-0145206c0630 admin admin] Request method failure captured: Jun 30 09:54:06.625536 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 30 09:54:06.625536 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: Accept: application/json Jun 30 09:54:06.625536 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: Accept-Encoding: gzip, deflate Jun 30 09:54:06.625536 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: Connection: keep-alive Jun 30 09:54:06.625536 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: Content-Length: 0 Jun 30 09:54:06.625536 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: Host: 10.222.0.16 Jun 30 09:54:06.625536 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: Openstack-Api-Version: compute 2.90 Jun 30 09:54:06.625536 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: Openstack-System-Scope: None Jun 30 09:54:06.625536 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: User-Agent: python-novaclient Jun 30 09:54:06.625536 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Auth-Token: gAAAAABivXK-qiSAJ91HETyduorrpTLErSMm3sQ_PgJXbHSpxxbKxiy0cDy5PtXCW-QDhrCsQ4w6uSVzeV2HxL-LQMCuG7MHdlK1gqD1c8oZrVjw_srVY6891XI05lYF9-FUgjHlM1xNfFTvxtLAjQzg-jcXAJPS7X9F3Yfd0U7QIKXmYoIU-QA Jun 30 09:54:06.625536 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Domain-Id: None Jun 30 09:54:06.625536 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Domain-Name: None Jun 30 09:54:06.625536 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Identity-Status: Confirmed Jun 30 09:54:06.625536 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Is-Admin-Project: True Jun 30 09:54:06.625536 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 09:54:06.625536 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Project-Domain-Id: default Jun 30 09:54:06.625536 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Project-Domain-Name: Default Jun 30 09:54:06.625536 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Project-Id: e04fd91b7cf34c948c016c3c7a5bd4df Jun 30 09:54:06.625536 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Project-Name: admin Jun 30 09:54:06.625536 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Role: admin,reader,member Jun 30 09:54:06.625536 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Roles: admin,reader,member Jun 30 09:54:06.627121 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e04fd91b7cf34c948c016c3c7a5bd4df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e04fd91b7cf34c948c016c3c7a5bd4df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e04fd91b7cf34c948c016c3c7a5bd4df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e04fd91b7cf34c948c016c3c7a5bd4df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 09:54:06.627121 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Tenant: admin Jun 30 09:54:06.627121 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Tenant-Id: e04fd91b7cf34c948c016c3c7a5bd4df Jun 30 09:54:06.627121 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Tenant-Name: admin Jun 30 09:54:06.627121 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-User: admin Jun 30 09:54:06.627121 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-User-Domain-Id: default Jun 30 09:54:06.627121 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-User-Domain-Name: Default Jun 30 09:54:06.627121 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-User-Id: 7c92e7defa704085b3b2760be29aa346 Jun 30 09:54:06.627121 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-User-Name: admin Jun 30 09:54:06.627121 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: method: > Jun 30 09:54:06.627121 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: exception: Flavor 42 could not be found. Jun 30 09:54:06.627121 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: action_args: {'id': '42'} Jun 30 09:54:06.627121 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: {{(pid=103119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 09:54:06.627121 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 09:54:06.628183 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 09:54:06.628183 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 09:54:06.628183 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 09:54:06.628183 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 09:54:06.628183 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 09:54:06.628183 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 09:54:06.628183 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 09:54:06.628183 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 09:54:06.628183 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 09:54:06.628183 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 09:54:06.628183 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 09:54:06.628183 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 09:54:06.628183 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 30 09:54:06.628183 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi Jun 30 09:54:06.628183 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 09:54:06.628183 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi Jun 30 09:54:06.628183 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 09:54:06.628183 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 09:54:06.628183 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 09:54:06.629416 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 09:54:06.629416 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 09:54:06.629416 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 09:54:06.629416 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 09:54:06.629416 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 09:54:06.629416 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 09:54:06.629416 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 30 09:54:06.629416 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi Jun 30 09:54:06.629416 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 09:54:06.629416 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi Jun 30 09:54:06.629416 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 09:54:06.629416 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 09:54:06.629416 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 09:54:06.629416 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 09:54:06.629416 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 09:54:06.629416 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 30 09:54:06.629416 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi Jun 30 09:54:06.629416 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi [None req-75e8c36a-3b22-4d1f-a6ca-0145206c0630 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 09:54:06.630465 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: INFO nova.api.openstack.requestlog [None req-75e8c36a-3b22-4d1f-a6ca-0145206c0630 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.074033 Jun 30 09:54:06.630465 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: [pid: 103119|app: 0|req: 20/39] 10.222.0.16 () {60 vars in 1190 bytes} [Thu Jun 30 09:54:06 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 30 09:54:06.636896 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi [None req-c777e70b-6e0e-45fa-87d0-46b0cdcb142c admin admin] Calling method '>' {{(pid=103118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:54:06.639904 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG dbcounter [-] [103118] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 09:54:06.659734 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: INFO nova.api.openstack.requestlog [None req-c777e70b-6e0e-45fa-87d0-46b0cdcb142c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026419 Jun 30 09:54:06.660278 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: [pid: 103118|app: 0|req: 20/40] 10.222.0.16 () {60 vars in 1210 bytes} [Thu Jun 30 09:54:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 09:54:06.670297 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi [None req-e2058134-b7f8-468a-9f5e-10963debdd9c admin admin] Calling method '>' {{(pid=103119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:54:06.692380 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: INFO nova.api.openstack.requestlog [None req-e2058134-b7f8-468a-9f5e-10963debdd9c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025720 Jun 30 09:54:06.692981 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: [pid: 103119|app: 0|req: 21/41] 10.222.0.16 () {60 vars in 1210 bytes} [Thu Jun 30 09:54:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 09:54:06.703817 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi [None req-92c7da36-cd5c-42b9-85d8-9c0a637bcbb8 admin admin] Calling method '>' {{(pid=103118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:54:06.709990 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: INFO nova.api.openstack.wsgi [None req-92c7da36-cd5c-42b9-85d8-9c0a637bcbb8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 30 09:54:06.713251 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi [None req-92c7da36-cd5c-42b9-85d8-9c0a637bcbb8 admin admin] Request method failure captured: Jun 30 09:54:06.713251 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 30 09:54:06.713251 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: Accept: application/json Jun 30 09:54:06.713251 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: Accept-Encoding: gzip, deflate Jun 30 09:54:06.713251 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: Connection: keep-alive Jun 30 09:54:06.713251 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: Content-Length: 0 Jun 30 09:54:06.713251 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: Host: 10.222.0.16 Jun 30 09:54:06.713251 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: Openstack-Api-Version: compute 2.90 Jun 30 09:54:06.713251 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: Openstack-System-Scope: None Jun 30 09:54:06.713251 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: User-Agent: python-novaclient Jun 30 09:54:06.713251 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Auth-Token: gAAAAABivXK-qiSAJ91HETyduorrpTLErSMm3sQ_PgJXbHSpxxbKxiy0cDy5PtXCW-QDhrCsQ4w6uSVzeV2HxL-LQMCuG7MHdlK1gqD1c8oZrVjw_srVY6891XI05lYF9-FUgjHlM1xNfFTvxtLAjQzg-jcXAJPS7X9F3Yfd0U7QIKXmYoIU-QA Jun 30 09:54:06.713251 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Domain-Id: None Jun 30 09:54:06.713251 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Domain-Name: None Jun 30 09:54:06.713251 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Identity-Status: Confirmed Jun 30 09:54:06.713251 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Is-Admin-Project: True Jun 30 09:54:06.713251 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 09:54:06.713251 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Project-Domain-Id: default Jun 30 09:54:06.713251 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Project-Domain-Name: Default Jun 30 09:54:06.713251 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Project-Id: e04fd91b7cf34c948c016c3c7a5bd4df Jun 30 09:54:06.713251 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Project-Name: admin Jun 30 09:54:06.713251 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Role: admin,reader,member Jun 30 09:54:06.713251 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Roles: admin,reader,member Jun 30 09:54:06.714713 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e04fd91b7cf34c948c016c3c7a5bd4df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e04fd91b7cf34c948c016c3c7a5bd4df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e04fd91b7cf34c948c016c3c7a5bd4df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e04fd91b7cf34c948c016c3c7a5bd4df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 09:54:06.714713 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Tenant: admin Jun 30 09:54:06.714713 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Tenant-Id: e04fd91b7cf34c948c016c3c7a5bd4df Jun 30 09:54:06.714713 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Tenant-Name: admin Jun 30 09:54:06.714713 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-User: admin Jun 30 09:54:06.714713 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-User-Domain-Id: default Jun 30 09:54:06.714713 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-User-Domain-Name: Default Jun 30 09:54:06.714713 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-User-Id: 7c92e7defa704085b3b2760be29aa346 Jun 30 09:54:06.714713 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-User-Name: admin Jun 30 09:54:06.714713 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: method: > Jun 30 09:54:06.714713 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: exception: Flavor 42 could not be found. Jun 30 09:54:06.714713 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: action_args: {'id': '42'} Jun 30 09:54:06.714713 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: {{(pid=103118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 09:54:06.714713 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 09:54:06.715653 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 09:54:06.715653 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 09:54:06.715653 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 09:54:06.715653 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 09:54:06.715653 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 09:54:06.715653 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 09:54:06.715653 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 09:54:06.715653 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 09:54:06.715653 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 09:54:06.715653 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 09:54:06.715653 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 09:54:06.715653 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 09:54:06.715653 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 30 09:54:06.715653 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi Jun 30 09:54:06.715653 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 09:54:06.715653 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi Jun 30 09:54:06.715653 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 09:54:06.715653 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 09:54:06.715653 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 09:54:06.716792 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 09:54:06.716792 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 09:54:06.716792 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 09:54:06.716792 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 09:54:06.716792 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 09:54:06.716792 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 09:54:06.716792 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 30 09:54:06.716792 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi Jun 30 09:54:06.716792 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 09:54:06.716792 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi Jun 30 09:54:06.716792 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 09:54:06.716792 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 09:54:06.716792 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 09:54:06.716792 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 09:54:06.716792 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 09:54:06.716792 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 30 09:54:06.716792 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi Jun 30 09:54:06.716792 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi [None req-92c7da36-cd5c-42b9-85d8-9c0a637bcbb8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 09:54:06.717778 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: INFO nova.api.openstack.requestlog [None req-92c7da36-cd5c-42b9-85d8-9c0a637bcbb8 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015657 Jun 30 09:54:06.717778 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: [pid: 103118|app: 0|req: 21/42] 10.222.0.16 () {60 vars in 1190 bytes} [Thu Jun 30 09:54:06 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 30 09:54:07.544071 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi [None req-e2058134-b7f8-468a-9f5e-10963debdd9c admin admin] Calling method '>' {{(pid=103119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:54:07.545016 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: INFO nova.api.openstack.requestlog [None req-e2058134-b7f8-468a-9f5e-10963debdd9c admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jun 30 09:54:07.545380 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: [pid: 103119|app: 0|req: 22/43] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Jun 30 09:54:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 09:54:07.743754 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi [None req-e4dec233-0908-41d8-8bde-f5a58c2840bb admin admin] Calling method '>' {{(pid=103118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:54:07.752587 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: INFO nova.api.openstack.wsgi [None req-e4dec233-0908-41d8-8bde-f5a58c2840bb admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 30 09:54:07.754879 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi [None req-e4dec233-0908-41d8-8bde-f5a58c2840bb admin admin] Request method failure captured: Jun 30 09:54:07.754879 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 30 09:54:07.754879 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: Accept: application/json Jun 30 09:54:07.754879 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: Accept-Encoding: gzip, deflate Jun 30 09:54:07.754879 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: Connection: keep-alive Jun 30 09:54:07.754879 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: Content-Length: 0 Jun 30 09:54:07.754879 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: Host: 10.222.0.16 Jun 30 09:54:07.754879 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: Openstack-Api-Version: compute 2.90 Jun 30 09:54:07.754879 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: Openstack-System-Scope: None Jun 30 09:54:07.754879 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: User-Agent: python-novaclient Jun 30 09:54:07.754879 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Auth-Token: gAAAAABivXK_t7DwIGVljbA_UdD1mdX_qNapFmki4fIUaTkjHF_PsbbI2KE4yhXbdIIkycy2p11WUsJxj6u6MacxDwhGbk74U4FxKvg9xnZ-ujzE_aoOIEJ5JQVkp28de_JDCcNpbyJlk3m9FHzCzv96yPHEjsFScR3-nX9lfEP2PC5LKAgmYus Jun 30 09:54:07.754879 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Domain-Id: None Jun 30 09:54:07.754879 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Domain-Name: None Jun 30 09:54:07.754879 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Identity-Status: Confirmed Jun 30 09:54:07.754879 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Is-Admin-Project: True Jun 30 09:54:07.754879 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 09:54:07.754879 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Project-Domain-Id: default Jun 30 09:54:07.754879 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Project-Domain-Name: Default Jun 30 09:54:07.754879 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Project-Id: e04fd91b7cf34c948c016c3c7a5bd4df Jun 30 09:54:07.754879 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Project-Name: admin Jun 30 09:54:07.754879 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Role: admin,reader,member Jun 30 09:54:07.754879 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Roles: admin,reader,member Jun 30 09:54:07.756437 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e04fd91b7cf34c948c016c3c7a5bd4df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e04fd91b7cf34c948c016c3c7a5bd4df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e04fd91b7cf34c948c016c3c7a5bd4df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e04fd91b7cf34c948c016c3c7a5bd4df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 09:54:07.756437 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Tenant: admin Jun 30 09:54:07.756437 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Tenant-Id: e04fd91b7cf34c948c016c3c7a5bd4df Jun 30 09:54:07.756437 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Tenant-Name: admin Jun 30 09:54:07.756437 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-User: admin Jun 30 09:54:07.756437 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-User-Domain-Id: default Jun 30 09:54:07.756437 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-User-Domain-Name: Default Jun 30 09:54:07.756437 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-User-Id: 7c92e7defa704085b3b2760be29aa346 Jun 30 09:54:07.756437 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-User-Name: admin Jun 30 09:54:07.756437 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: method: > Jun 30 09:54:07.756437 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: exception: Flavor 84 could not be found. Jun 30 09:54:07.756437 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: action_args: {'id': '84'} Jun 30 09:54:07.756437 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: {{(pid=103118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 09:54:07.756437 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 09:54:07.757289 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 09:54:07.757289 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 09:54:07.757289 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 09:54:07.757289 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 09:54:07.757289 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 09:54:07.757289 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 09:54:07.757289 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 09:54:07.757289 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 09:54:07.757289 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 09:54:07.757289 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 09:54:07.757289 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 09:54:07.757289 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 09:54:07.757289 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 30 09:54:07.757289 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi Jun 30 09:54:07.757289 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 09:54:07.757289 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi Jun 30 09:54:07.757289 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 09:54:07.757289 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 09:54:07.757289 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 09:54:07.758320 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 09:54:07.758320 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 09:54:07.758320 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 09:54:07.758320 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 09:54:07.758320 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 09:54:07.758320 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 09:54:07.758320 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 30 09:54:07.758320 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi Jun 30 09:54:07.758320 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 09:54:07.758320 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi Jun 30 09:54:07.758320 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 09:54:07.758320 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 09:54:07.758320 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 09:54:07.758320 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 09:54:07.758320 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 09:54:07.758320 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 30 09:54:07.758320 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi Jun 30 09:54:07.758320 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi [None req-e4dec233-0908-41d8-8bde-f5a58c2840bb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 09:54:07.759332 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: INFO nova.api.openstack.requestlog [None req-e4dec233-0908-41d8-8bde-f5a58c2840bb admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.076185 Jun 30 09:54:07.759332 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: [pid: 103118|app: 0|req: 22/44] 10.222.0.16 () {60 vars in 1190 bytes} [Thu Jun 30 09:54:07 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 30 09:54:07.768349 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi [None req-fe64c254-831b-4b6c-b2eb-eaf4d887cf81 admin admin] Calling method '>' {{(pid=103119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:54:07.783829 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: INFO nova.api.openstack.requestlog [None req-fe64c254-831b-4b6c-b2eb-eaf4d887cf81 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020343 Jun 30 09:54:07.784420 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: [pid: 103119|app: 0|req: 23/45] 10.222.0.16 () {60 vars in 1210 bytes} [Thu Jun 30 09:54:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 09:54:07.793950 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi [None req-6d75a621-a948-404b-b3f2-ba14b4c6054a admin admin] Calling method '>' {{(pid=103118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:54:07.809485 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: INFO nova.api.openstack.requestlog [None req-6d75a621-a948-404b-b3f2-ba14b4c6054a admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018999 Jun 30 09:54:07.809936 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: [pid: 103118|app: 0|req: 23/46] 10.222.0.16 () {60 vars in 1210 bytes} [Thu Jun 30 09:54:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 09:54:07.822013 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi [None req-3c433f82-bc36-4495-ae2b-92be47678d69 admin admin] Calling method '>' {{(pid=103119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:54:07.830225 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: INFO nova.api.openstack.wsgi [None req-3c433f82-bc36-4495-ae2b-92be47678d69 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 30 09:54:07.832080 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi [None req-3c433f82-bc36-4495-ae2b-92be47678d69 admin admin] Request method failure captured: Jun 30 09:54:07.832080 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 30 09:54:07.832080 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: Accept: application/json Jun 30 09:54:07.832080 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: Accept-Encoding: gzip, deflate Jun 30 09:54:07.832080 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: Connection: keep-alive Jun 30 09:54:07.832080 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: Content-Length: 0 Jun 30 09:54:07.832080 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: Host: 10.222.0.16 Jun 30 09:54:07.832080 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: Openstack-Api-Version: compute 2.90 Jun 30 09:54:07.832080 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: Openstack-System-Scope: None Jun 30 09:54:07.832080 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: User-Agent: python-novaclient Jun 30 09:54:07.832080 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Auth-Token: gAAAAABivXK_t7DwIGVljbA_UdD1mdX_qNapFmki4fIUaTkjHF_PsbbI2KE4yhXbdIIkycy2p11WUsJxj6u6MacxDwhGbk74U4FxKvg9xnZ-ujzE_aoOIEJ5JQVkp28de_JDCcNpbyJlk3m9FHzCzv96yPHEjsFScR3-nX9lfEP2PC5LKAgmYus Jun 30 09:54:07.832080 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Domain-Id: None Jun 30 09:54:07.832080 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Domain-Name: None Jun 30 09:54:07.832080 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Identity-Status: Confirmed Jun 30 09:54:07.832080 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Is-Admin-Project: True Jun 30 09:54:07.832080 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 09:54:07.832080 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Project-Domain-Id: default Jun 30 09:54:07.832080 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Project-Domain-Name: Default Jun 30 09:54:07.832080 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Project-Id: e04fd91b7cf34c948c016c3c7a5bd4df Jun 30 09:54:07.832080 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Project-Name: admin Jun 30 09:54:07.832080 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Role: admin,reader,member Jun 30 09:54:07.832080 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Roles: admin,reader,member Jun 30 09:54:07.833532 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e04fd91b7cf34c948c016c3c7a5bd4df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e04fd91b7cf34c948c016c3c7a5bd4df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e04fd91b7cf34c948c016c3c7a5bd4df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e04fd91b7cf34c948c016c3c7a5bd4df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 09:54:07.833532 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Tenant: admin Jun 30 09:54:07.833532 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Tenant-Id: e04fd91b7cf34c948c016c3c7a5bd4df Jun 30 09:54:07.833532 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Tenant-Name: admin Jun 30 09:54:07.833532 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-User: admin Jun 30 09:54:07.833532 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-User-Domain-Id: default Jun 30 09:54:07.833532 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-User-Domain-Name: Default Jun 30 09:54:07.833532 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-User-Id: 7c92e7defa704085b3b2760be29aa346 Jun 30 09:54:07.833532 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-User-Name: admin Jun 30 09:54:07.833532 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: method: > Jun 30 09:54:07.833532 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: exception: Flavor 84 could not be found. Jun 30 09:54:07.833532 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: action_args: {'id': '84'} Jun 30 09:54:07.833532 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: {{(pid=103119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 09:54:07.833532 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 09:54:07.834407 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 09:54:07.834407 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 09:54:07.834407 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 09:54:07.834407 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 09:54:07.834407 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 09:54:07.834407 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 09:54:07.834407 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 09:54:07.834407 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 09:54:07.834407 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 09:54:07.834407 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 09:54:07.834407 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 09:54:07.834407 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 09:54:07.834407 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 30 09:54:07.834407 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi Jun 30 09:54:07.834407 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 09:54:07.834407 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi Jun 30 09:54:07.834407 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 09:54:07.834407 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 09:54:07.834407 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 09:54:07.835703 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 09:54:07.835703 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 09:54:07.835703 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 09:54:07.835703 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 09:54:07.835703 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 09:54:07.835703 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 09:54:07.835703 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 30 09:54:07.835703 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi Jun 30 09:54:07.835703 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 09:54:07.835703 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi Jun 30 09:54:07.835703 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 09:54:07.835703 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 09:54:07.835703 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 09:54:07.835703 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 09:54:07.835703 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 09:54:07.835703 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 30 09:54:07.835703 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi Jun 30 09:54:07.835703 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi [None req-3c433f82-bc36-4495-ae2b-92be47678d69 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 09:54:07.836936 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: INFO nova.api.openstack.requestlog [None req-3c433f82-bc36-4495-ae2b-92be47678d69 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.017523 Jun 30 09:54:07.836936 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: [pid: 103119|app: 0|req: 24/47] 10.222.0.16 () {60 vars in 1190 bytes} [Thu Jun 30 09:54:07 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 30 09:54:08.648931 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi [None req-6d75a621-a948-404b-b3f2-ba14b4c6054a admin admin] Calling method '>' {{(pid=103118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:54:08.649923 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: INFO nova.api.openstack.requestlog [None req-6d75a621-a948-404b-b3f2-ba14b4c6054a admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001913 Jun 30 09:54:08.650304 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: [pid: 103118|app: 0|req: 24/48] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Jun 30 09:54:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 09:54:08.856350 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi [None req-8d244173-81f2-4811-87d5-4d9c446d4fef admin admin] Calling method '>' {{(pid=103119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:54:08.862450 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: INFO nova.api.openstack.wsgi [None req-8d244173-81f2-4811-87d5-4d9c446d4fef admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 30 09:54:08.863988 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi [None req-8d244173-81f2-4811-87d5-4d9c446d4fef admin admin] Request method failure captured: Jun 30 09:54:08.863988 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 30 09:54:08.863988 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: Accept: application/json Jun 30 09:54:08.863988 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: Accept-Encoding: gzip, deflate Jun 30 09:54:08.863988 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: Connection: keep-alive Jun 30 09:54:08.863988 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: Content-Length: 0 Jun 30 09:54:08.863988 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: Host: 10.222.0.16 Jun 30 09:54:08.863988 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: Openstack-Api-Version: compute 2.90 Jun 30 09:54:08.863988 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: Openstack-System-Scope: None Jun 30 09:54:08.863988 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: User-Agent: python-novaclient Jun 30 09:54:08.863988 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Auth-Token: gAAAAABivXLAHFArxqFssws5y6HHONUwZhSn_TMzYdPyH10xZ-f-X5naSfOT-3lKjtsFzB_cnHXhJT4IA_lGlk70XSDqDFoz6U4miVtD7Pog546CYdYE2Lz6Na05OeLqu0YRwHQUPBsPD4CI_T_vhc8Qdjdc6kSUGlSiGlo391wJ-V-Yo3bPyko Jun 30 09:54:08.863988 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Domain-Id: None Jun 30 09:54:08.863988 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Domain-Name: None Jun 30 09:54:08.863988 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Identity-Status: Confirmed Jun 30 09:54:08.863988 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Is-Admin-Project: True Jun 30 09:54:08.863988 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 09:54:08.863988 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Project-Domain-Id: default Jun 30 09:54:08.863988 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Project-Domain-Name: Default Jun 30 09:54:08.863988 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Project-Id: e04fd91b7cf34c948c016c3c7a5bd4df Jun 30 09:54:08.863988 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Project-Name: admin Jun 30 09:54:08.863988 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Role: admin,reader,member Jun 30 09:54:08.863988 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Roles: admin,reader,member Jun 30 09:54:08.865372 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e04fd91b7cf34c948c016c3c7a5bd4df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e04fd91b7cf34c948c016c3c7a5bd4df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e04fd91b7cf34c948c016c3c7a5bd4df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e04fd91b7cf34c948c016c3c7a5bd4df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 09:54:08.865372 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Tenant: admin Jun 30 09:54:08.865372 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Tenant-Id: e04fd91b7cf34c948c016c3c7a5bd4df Jun 30 09:54:08.865372 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-Tenant-Name: admin Jun 30 09:54:08.865372 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-User: admin Jun 30 09:54:08.865372 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-User-Domain-Id: default Jun 30 09:54:08.865372 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-User-Domain-Name: Default Jun 30 09:54:08.865372 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-User-Id: 7c92e7defa704085b3b2760be29aa346 Jun 30 09:54:08.865372 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: X-User-Name: admin Jun 30 09:54:08.865372 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: method: > Jun 30 09:54:08.865372 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: exception: Flavor 451 could not be found. Jun 30 09:54:08.865372 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: action_args: {'id': '451'} Jun 30 09:54:08.865372 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: {{(pid=103119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 09:54:08.865372 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 09:54:08.866168 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 09:54:08.866168 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 09:54:08.866168 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 09:54:08.866168 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 09:54:08.866168 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 09:54:08.866168 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 09:54:08.866168 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 09:54:08.866168 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 09:54:08.866168 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 09:54:08.866168 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 09:54:08.866168 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 09:54:08.866168 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 09:54:08.866168 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 30 09:54:08.866168 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi Jun 30 09:54:08.866168 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 09:54:08.866168 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi Jun 30 09:54:08.866168 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 09:54:08.866168 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 09:54:08.866168 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 09:54:08.867188 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 09:54:08.867188 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 09:54:08.867188 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 09:54:08.867188 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 09:54:08.867188 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 09:54:08.867188 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 09:54:08.867188 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 30 09:54:08.867188 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi Jun 30 09:54:08.867188 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 09:54:08.867188 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi Jun 30 09:54:08.867188 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 09:54:08.867188 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 09:54:08.867188 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 09:54:08.867188 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 09:54:08.867188 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 09:54:08.867188 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 30 09:54:08.867188 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: ERROR nova.api.openstack.wsgi Jun 30 09:54:08.867188 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi [None req-8d244173-81f2-4811-87d5-4d9c446d4fef admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 09:54:08.868217 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: INFO nova.api.openstack.requestlog [None req-8d244173-81f2-4811-87d5-4d9c446d4fef admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.073661 Jun 30 09:54:08.868217 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: [pid: 103119|app: 0|req: 25/49] 10.222.0.16 () {60 vars in 1193 bytes} [Thu Jun 30 09:54:08 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 30 09:54:08.878019 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi [None req-aefe4beb-3013-46e1-857d-3075d53d7939 admin admin] Calling method '>' {{(pid=103118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:54:08.891852 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: INFO nova.api.openstack.requestlog [None req-aefe4beb-3013-46e1-857d-3075d53d7939 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019973 Jun 30 09:54:08.892359 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: [pid: 103118|app: 0|req: 25/50] 10.222.0.16 () {60 vars in 1210 bytes} [Thu Jun 30 09:54:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 09:54:08.902022 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi [None req-6186d30b-1510-4d4b-802a-5a7397326724 admin admin] Calling method '>' {{(pid=103119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:54:08.916214 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: INFO nova.api.openstack.requestlog [None req-6186d30b-1510-4d4b-802a-5a7397326724 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017623 Jun 30 09:54:08.916731 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: [pid: 103119|app: 0|req: 26/51] 10.222.0.16 () {60 vars in 1210 bytes} [Thu Jun 30 09:54:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 09:54:08.926573 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi [None req-6ee8cfd1-db70-426c-9571-ea7717d288f4 admin admin] Calling method '>' {{(pid=103118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:54:08.932189 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: INFO nova.api.openstack.wsgi [None req-6ee8cfd1-db70-426c-9571-ea7717d288f4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 30 09:54:08.933696 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi [None req-6ee8cfd1-db70-426c-9571-ea7717d288f4 admin admin] Request method failure captured: Jun 30 09:54:08.933696 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 30 09:54:08.933696 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: Accept: application/json Jun 30 09:54:08.933696 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: Accept-Encoding: gzip, deflate Jun 30 09:54:08.933696 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: Connection: keep-alive Jun 30 09:54:08.933696 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: Content-Length: 0 Jun 30 09:54:08.933696 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: Host: 10.222.0.16 Jun 30 09:54:08.933696 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: Openstack-Api-Version: compute 2.90 Jun 30 09:54:08.933696 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: Openstack-System-Scope: None Jun 30 09:54:08.933696 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: User-Agent: python-novaclient Jun 30 09:54:08.933696 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Auth-Token: gAAAAABivXLAHFArxqFssws5y6HHONUwZhSn_TMzYdPyH10xZ-f-X5naSfOT-3lKjtsFzB_cnHXhJT4IA_lGlk70XSDqDFoz6U4miVtD7Pog546CYdYE2Lz6Na05OeLqu0YRwHQUPBsPD4CI_T_vhc8Qdjdc6kSUGlSiGlo391wJ-V-Yo3bPyko Jun 30 09:54:08.933696 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Domain-Id: None Jun 30 09:54:08.933696 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Domain-Name: None Jun 30 09:54:08.933696 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Identity-Status: Confirmed Jun 30 09:54:08.933696 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Is-Admin-Project: True Jun 30 09:54:08.933696 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 09:54:08.933696 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Project-Domain-Id: default Jun 30 09:54:08.933696 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Project-Domain-Name: Default Jun 30 09:54:08.933696 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Project-Id: e04fd91b7cf34c948c016c3c7a5bd4df Jun 30 09:54:08.933696 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Project-Name: admin Jun 30 09:54:08.933696 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Role: admin,reader,member Jun 30 09:54:08.933696 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Roles: admin,reader,member Jun 30 09:54:08.935164 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e04fd91b7cf34c948c016c3c7a5bd4df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e04fd91b7cf34c948c016c3c7a5bd4df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e04fd91b7cf34c948c016c3c7a5bd4df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e04fd91b7cf34c948c016c3c7a5bd4df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 09:54:08.935164 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Tenant: admin Jun 30 09:54:08.935164 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Tenant-Id: e04fd91b7cf34c948c016c3c7a5bd4df Jun 30 09:54:08.935164 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-Tenant-Name: admin Jun 30 09:54:08.935164 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-User: admin Jun 30 09:54:08.935164 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-User-Domain-Id: default Jun 30 09:54:08.935164 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-User-Domain-Name: Default Jun 30 09:54:08.935164 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-User-Id: 7c92e7defa704085b3b2760be29aa346 Jun 30 09:54:08.935164 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: X-User-Name: admin Jun 30 09:54:08.935164 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: method: > Jun 30 09:54:08.935164 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: exception: Flavor 451 could not be found. Jun 30 09:54:08.935164 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: action_args: {'id': '451'} Jun 30 09:54:08.935164 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: {{(pid=103118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 09:54:08.935164 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 09:54:08.936168 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 09:54:08.936168 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 09:54:08.936168 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 09:54:08.936168 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 09:54:08.936168 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 09:54:08.936168 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 09:54:08.936168 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 09:54:08.936168 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 09:54:08.936168 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 09:54:08.936168 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 09:54:08.936168 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 09:54:08.936168 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 09:54:08.936168 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 30 09:54:08.936168 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi Jun 30 09:54:08.936168 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 09:54:08.936168 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi Jun 30 09:54:08.936168 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 09:54:08.936168 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 09:54:08.936168 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 09:54:08.937380 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 09:54:08.937380 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 09:54:08.937380 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 09:54:08.937380 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 09:54:08.937380 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 09:54:08.937380 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 09:54:08.937380 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 30 09:54:08.937380 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi Jun 30 09:54:08.937380 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 09:54:08.937380 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi Jun 30 09:54:08.937380 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 09:54:08.937380 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 09:54:08.937380 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 09:54:08.937380 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 09:54:08.937380 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 09:54:08.937380 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 30 09:54:08.937380 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: ERROR nova.api.openstack.wsgi Jun 30 09:54:08.937380 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi [None req-6ee8cfd1-db70-426c-9571-ea7717d288f4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 09:54:08.938652 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: INFO nova.api.openstack.requestlog [None req-6ee8cfd1-db70-426c-9571-ea7717d288f4 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012501 Jun 30 09:54:08.938652 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: [pid: 103118|app: 0|req: 26/52] 10.222.0.16 () {60 vars in 1193 bytes} [Thu Jun 30 09:54:08 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 30 09:54:09.764428 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi [None req-6186d30b-1510-4d4b-802a-5a7397326724 admin admin] Calling method '>' {{(pid=103119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:54:09.765432 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: INFO nova.api.openstack.requestlog [None req-6186d30b-1510-4d4b-802a-5a7397326724 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Jun 30 09:54:09.765857 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: [pid: 103119|app: 0|req: 27/53] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Jun 30 09:54:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 09:54:09.968637 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi [None req-fa7cce59-8c14-48cc-80fe-ef32b9dd169b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 09:54:09.990155 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: INFO nova.api.openstack.requestlog [None req-fa7cce59-8c14-48cc-80fe-ef32b9dd169b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.085235 Jun 30 09:54:09.990611 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: [pid: 103118|app: 0|req: 27/54] 10.222.0.16 () {64 vars in 1235 bytes} [Thu Jun 30 09:54:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 09:54:10.814621 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi [None req-6186d30b-1510-4d4b-802a-5a7397326724 admin admin] Calling method '>' {{(pid=103119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:54:10.815613 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: INFO nova.api.openstack.requestlog [None req-6186d30b-1510-4d4b-802a-5a7397326724 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Jun 30 09:54:10.816028 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: [pid: 103119|app: 0|req: 28/55] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Jun 30 09:54:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 09:54:11.021213 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi [None req-930ae5bd-f9b1-425a-b7c8-72f46e91fb6c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 09:54:11.041092 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: INFO nova.api.openstack.requestlog [None req-930ae5bd-f9b1-425a-b7c8-72f46e91fb6c admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.087373 Jun 30 09:54:11.041659 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: [pid: 103118|app: 0|req: 28/56] 10.222.0.16 () {64 vars in 1235 bytes} [Thu Jun 30 09:54:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 09:54:11.874452 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi [None req-6186d30b-1510-4d4b-802a-5a7397326724 admin admin] Calling method '>' {{(pid=103119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:54:11.875497 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: INFO nova.api.openstack.requestlog [None req-6186d30b-1510-4d4b-802a-5a7397326724 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Jun 30 09:54:11.875914 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: [pid: 103119|app: 0|req: 29/57] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Jun 30 09:54:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 09:54:12.072374 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi [None req-a0a393fd-6dcf-4fd8-8772-4501a0906ce9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 09:54:12.094145 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: INFO nova.api.openstack.requestlog [None req-a0a393fd-6dcf-4fd8-8772-4501a0906ce9 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.081546 Jun 30 09:54:12.094676 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: [pid: 103118|app: 0|req: 29/58] 10.222.0.16 () {64 vars in 1235 bytes} [Thu Jun 30 09:54:12 2022] POST /compute/v2.1/flavors => generated 407 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 09:54:12.929190 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi [None req-6186d30b-1510-4d4b-802a-5a7397326724 admin admin] Calling method '>' {{(pid=103119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:54:12.930226 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: INFO nova.api.openstack.requestlog [None req-6186d30b-1510-4d4b-802a-5a7397326724 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jun 30 09:54:12.930613 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: [pid: 103119|app: 0|req: 30/59] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Jun 30 09:54:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 09:54:13.123339 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi [None req-a7067e06-228b-4078-9f9a-7fc10f5c311c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 09:54:13.143137 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: INFO nova.api.openstack.requestlog [None req-a7067e06-228b-4078-9f9a-7fc10f5c311c admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.076349 Jun 30 09:54:13.143590 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: [pid: 103118|app: 0|req: 30/60] 10.222.0.16 () {64 vars in 1235 bytes} [Thu Jun 30 09:54:13 2022] POST /compute/v2.1/flavors => generated 409 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 09:54:13.960672 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi [None req-6186d30b-1510-4d4b-802a-5a7397326724 admin admin] Calling method '>' {{(pid=103119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:54:13.961723 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: INFO nova.api.openstack.requestlog [None req-6186d30b-1510-4d4b-802a-5a7397326724 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jun 30 09:54:13.962085 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: [pid: 103119|app: 0|req: 31/61] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Jun 30 09:54:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 09:54:14.163499 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi [None req-12aace0a-eb04-42a0-9c2a-1bb434072915 admin admin] Calling method '>' {{(pid=103118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:54:14.182694 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: INFO nova.api.openstack.requestlog [None req-12aace0a-eb04-42a0-9c2a-1bb434072915 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.085721 Jun 30 09:54:14.183158 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: [pid: 103118|app: 0|req: 31/62] 10.222.0.16 () {60 vars in 1202 bytes} [Thu Jun 30 09:54:14 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 09:55:00.872193 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi [None req-6186d30b-1510-4d4b-802a-5a7397326724 admin admin] Calling method '>' {{(pid=103119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:55:00.873734 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: INFO nova.api.openstack.requestlog [None req-6186d30b-1510-4d4b-802a-5a7397326724 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002169 Jun 30 09:55:00.874245 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: [pid: 103119|app: 0|req: 32/63] 10.222.0.16 () {54 vars in 930 bytes} [Thu Jun 30 09:55:00 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 09:55:00.888020 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG dbcounter [-] [103118] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 09:55:00.937257 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi [None req-24fc75b0-a1d2-4c8b-b1c7-3553afc0b5b7 admin admin] Calling method '>' {{(pid=103118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:55:00.956800 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: INFO nova.api.openstack.requestlog [None req-24fc75b0-a1d2-4c8b-b1c7-3553afc0b5b7 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.075891 Jun 30 09:55:00.957326 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: [pid: 103118|app: 0|req: 32/64] 10.222.0.16 () {60 vars in 1291 bytes} [Thu Jun 30 09:55:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 09:55:00.991128 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi [None req-9d1e982d-4d0c-4edd-9991-3331f865d4da admin admin] Calling method '>' {{(pid=103119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:55:00.994667 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG dbcounter [-] [103119] Writing DB stats nova_api:SELECT=14 {{(pid=103119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 09:55:01.000489 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: INFO nova.api.openstack.requestlog [None req-9d1e982d-4d0c-4edd-9991-3331f865d4da admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013053 Jun 30 09:55:01.001023 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: [pid: 103119|app: 0|req: 33/65] 10.222.0.16 () {60 vars in 1282 bytes} [Thu Jun 30 09:55:00 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 09:55:01.012691 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi [None req-9a354907-5044-4e8d-8447-8850d1030b51 admin admin] Calling method '>' {{(pid=103118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:55:01.020877 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: INFO nova.api.openstack.requestlog [None req-9a354907-5044-4e8d-8447-8850d1030b51 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011836 Jun 30 09:55:01.021404 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: [pid: 103118|app: 0|req: 33/66] 10.222.0.16 () {60 vars in 1285 bytes} [Thu Jun 30 09:55:01 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 09:55:01.033198 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi [None req-66dbb4a0-0703-48a8-b7a4-a415352545ac admin admin] Calling method '>' {{(pid=103119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:55:01.041107 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: INFO nova.api.openstack.requestlog [None req-66dbb4a0-0703-48a8-b7a4-a415352545ac admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011915 Jun 30 09:55:01.041627 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: [pid: 103119|app: 0|req: 34/67] 10.222.0.16 () {60 vars in 1285 bytes} [Thu Jun 30 09:55:01 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 09:55:01.052905 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi [None req-41fab4e1-bced-49c3-a43b-c4751b4d926f admin admin] Calling method '>' {{(pid=103118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:55:01.060624 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: INFO nova.api.openstack.requestlog [None req-41fab4e1-bced-49c3-a43b-c4751b4d926f admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011340 Jun 30 09:55:01.061129 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: [pid: 103118|app: 0|req: 34/68] 10.222.0.16 () {60 vars in 1282 bytes} [Thu Jun 30 09:55:01 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 09:58:23.130578 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi [None req-66dbb4a0-0703-48a8-b7a4-a415352545ac admin admin] Calling method '>' {{(pid=103119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:58:23.131589 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: INFO nova.api.openstack.requestlog [None req-66dbb4a0-0703-48a8-b7a4-a415352545ac admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001574 Jun 30 09:58:23.132010 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: [pid: 103119|app: 0|req: 35/69] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Jun 30 09:58:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 09:58:23.271131 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG dbcounter [-] [103118] Writing DB stats nova_api:SELECT=6 {{(pid=103118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 09:58:23.404341 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi [None req-69eaa61c-cc43-48fe-aa6f-55c9663f0905 admin admin] Calling method '>' {{(pid=103118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:58:23.405511 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 09:58:23.405511 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: warnings.warn(msg) Jun 30 09:58:23.406735 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG oslo_concurrency.lockutils [None req-69eaa61c-cc43-48fe-aa6f-55c9663f0905 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 09:58:23.407172 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG oslo_concurrency.lockutils [None req-69eaa61c-cc43-48fe-aa6f-55c9663f0905 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 09:58:23.407967 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG oslo_concurrency.lockutils [None req-69eaa61c-cc43-48fe-aa6f-55c9663f0905 admin admin] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 09:58:23.408384 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG oslo_concurrency.lockutils [None req-69eaa61c-cc43-48fe-aa6f-55c9663f0905 admin admin] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 09:58:23.443319 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: INFO nova.api.openstack.requestlog [None req-69eaa61c-cc43-48fe-aa6f-55c9663f0905 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.173526 Jun 30 09:58:23.443892 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: [pid: 103118|app: 0|req: 35/70] 10.222.0.16 () {60 vars in 1193 bytes} [Thu Jun 30 09:58:23 2022] GET /compute/v2.1/os-services => generated 791 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 09:58:24.286394 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi [None req-66dbb4a0-0703-48a8-b7a4-a415352545ac admin admin] Calling method '>' {{(pid=103119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:58:24.287643 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: INFO nova.api.openstack.requestlog [None req-66dbb4a0-0703-48a8-b7a4-a415352545ac admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001619 Jun 30 09:58:24.288132 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: [pid: 103119|app: 0|req: 36/71] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Jun 30 09:58:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 09:58:24.487676 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi [None req-870930f6-48e0-4538-8843-28c37e1f6615 admin admin] Calling method '>' {{(pid=103118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:58:24.488890 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 09:58:24.488890 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: warnings.warn(msg) Jun 30 09:58:24.490749 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG oslo_concurrency.lockutils [None req-870930f6-48e0-4538-8843-28c37e1f6615 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 09:58:24.491077 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG oslo_concurrency.lockutils [None req-870930f6-48e0-4538-8843-28c37e1f6615 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 09:58:24.491974 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG oslo_concurrency.lockutils [None req-870930f6-48e0-4538-8843-28c37e1f6615 admin admin] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 09:58:24.492520 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG oslo_concurrency.lockutils [None req-870930f6-48e0-4538-8843-28c37e1f6615 admin admin] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 09:58:24.513129 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: INFO nova.api.openstack.requestlog [None req-870930f6-48e0-4538-8843-28c37e1f6615 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.083750 Jun 30 09:58:24.513693 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: [pid: 103118|app: 0|req: 36/72] 10.222.0.16 () {60 vars in 1193 bytes} [Thu Jun 30 09:58:24 2022] GET /compute/v2.1/os-services => generated 791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 09:58:35.795814 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi [None req-66dbb4a0-0703-48a8-b7a4-a415352545ac admin admin] Calling method '>' {{(pid=103119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:58:35.796877 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: INFO nova.api.openstack.requestlog [None req-66dbb4a0-0703-48a8-b7a4-a415352545ac admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Jun 30 09:58:35.797275 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: [pid: 103119|app: 0|req: 37/73] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Jun 30 09:58:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 09:58:35.944316 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG dbcounter [-] [103118] Writing DB stats nova_cell0:SELECT=4 {{(pid=103118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 09:58:35.945293 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG dbcounter [-] [103118] Writing DB stats nova_cell1:SELECT=4 {{(pid=103118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 09:58:35.946986 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG dbcounter [-] [103118] Writing DB stats nova_api:SELECT=8 {{(pid=103118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 09:58:36.012388 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi [None req-b75ecdd5-3248-461e-b1e2-0c280d3ac137 admin admin] Calling method '>' {{(pid=103118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:58:36.013524 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 09:58:36.013524 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: warnings.warn(msg) Jun 30 09:58:36.014726 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG oslo_concurrency.lockutils [None req-b75ecdd5-3248-461e-b1e2-0c280d3ac137 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 09:58:36.015198 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG oslo_concurrency.lockutils [None req-b75ecdd5-3248-461e-b1e2-0c280d3ac137 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 09:58:36.016047 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG oslo_concurrency.lockutils [None req-b75ecdd5-3248-461e-b1e2-0c280d3ac137 admin admin] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 09:58:36.016435 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG oslo_concurrency.lockutils [None req-b75ecdd5-3248-461e-b1e2-0c280d3ac137 admin admin] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 09:58:36.041372 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: INFO nova.api.openstack.requestlog [None req-b75ecdd5-3248-461e-b1e2-0c280d3ac137 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.104924 Jun 30 09:58:36.041932 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: [pid: 103118|app: 0|req: 37/74] 10.222.0.16 () {60 vars in 1193 bytes} [Thu Jun 30 09:58:35 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 09:58:36.867804 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: DEBUG nova.api.openstack.wsgi [None req-66dbb4a0-0703-48a8-b7a4-a415352545ac admin admin] Calling method '>' {{(pid=103119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:58:36.868862 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: INFO nova.api.openstack.requestlog [None req-66dbb4a0-0703-48a8-b7a4-a415352545ac admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Jun 30 09:58:36.869255 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: [pid: 103119|app: 0|req: 38/75] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Jun 30 09:58:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 09:58:37.089922 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG nova.api.openstack.wsgi [None req-264f19a7-5a0b-42f2-9c0e-594f961d1d3e admin admin] Calling method '>' {{(pid=103118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 09:58:37.091902 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 09:58:37.091902 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: warnings.warn(msg) Jun 30 09:58:37.093296 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG oslo_concurrency.lockutils [None req-264f19a7-5a0b-42f2-9c0e-594f961d1d3e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 09:58:37.093771 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG oslo_concurrency.lockutils [None req-264f19a7-5a0b-42f2-9c0e-594f961d1d3e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 09:58:37.094542 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG oslo_concurrency.lockutils [None req-264f19a7-5a0b-42f2-9c0e-594f961d1d3e admin admin] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 09:58:37.095038 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: DEBUG oslo_concurrency.lockutils [None req-264f19a7-5a0b-42f2-9c0e-594f961d1d3e admin admin] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 09:58:37.117911 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: INFO nova.api.openstack.requestlog [None req-264f19a7-5a0b-42f2-9c0e-594f961d1d3e admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.091660 Jun 30 09:58:37.118491 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: [pid: 103118|app: 0|req: 38/76] 10.222.0.16 () {60 vars in 1193 bytes} [Thu Jun 30 09:58:37 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 09:59:33.591109 dv-cinder-843309-3-iscsi devstack@n-api.service[103117]: Thu Jun 30 09:59:33 2022 - graceful shutdown triggered... Jun 30 09:59:33.591010 dv-cinder-843309-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 30 09:59:33.592269 dv-cinder-843309-3-iscsi devstack@n-api.service[103118]: Gracefully killing worker 1 (pid: 103118)... Jun 30 09:59:33.592626 dv-cinder-843309-3-iscsi devstack@n-api.service[103119]: Gracefully killing worker 2 (pid: 103119)... Jun 30 09:59:34.592257 dv-cinder-843309-3-iscsi devstack@n-api.service[103117]: worker 1 buried after 1 seconds Jun 30 09:59:34.592257 dv-cinder-843309-3-iscsi devstack@n-api.service[103117]: worker 2 buried after 1 seconds Jun 30 09:59:34.592257 dv-cinder-843309-3-iscsi devstack@n-api.service[103117]: goodbye to uWSGI. Jun 30 09:59:34.594438 dv-cinder-843309-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 30 09:59:34.595011 dv-cinder-843309-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 30 09:59:34.599181 dv-cinder-843309-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 30 09:59:34.620690 dv-cinder-843309-3-iscsi devstack@n-api.service[117831]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 30 09:59:34.623449 dv-cinder-843309-3-iscsi devstack@n-api.service[117831]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 30 09:59:34 2022] *** Jun 30 09:59:34.623449 dv-cinder-843309-3-iscsi devstack@n-api.service[117831]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 30 09:59:34.623449 dv-cinder-843309-3-iscsi devstack@n-api.service[117831]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 30 09:59:34.623449 dv-cinder-843309-3-iscsi devstack@n-api.service[117831]: nodename: dv-cinder-843309-3-iscsi Jun 30 09:59:34.623449 dv-cinder-843309-3-iscsi devstack@n-api.service[117831]: machine: x86_64 Jun 30 09:59:34.623449 dv-cinder-843309-3-iscsi devstack@n-api.service[117831]: clock source: unix Jun 30 09:59:34.623449 dv-cinder-843309-3-iscsi devstack@n-api.service[117831]: pcre jit disabled Jun 30 09:59:34.623449 dv-cinder-843309-3-iscsi devstack@n-api.service[117831]: detected number of CPU cores: 4 Jun 30 09:59:34.623449 dv-cinder-843309-3-iscsi devstack@n-api.service[117831]: current working directory: / Jun 30 09:59:34.623449 dv-cinder-843309-3-iscsi devstack@n-api.service[117831]: detected binary path: /usr/bin/uwsgi-core Jun 30 09:59:34.623449 dv-cinder-843309-3-iscsi devstack@n-api.service[117831]: your processes number limit is 47680 Jun 30 09:59:34.623449 dv-cinder-843309-3-iscsi devstack@n-api.service[117831]: your memory page size is 4096 bytes Jun 30 09:59:34.623449 dv-cinder-843309-3-iscsi devstack@n-api.service[117831]: detected max file descriptor number: 2048 Jun 30 09:59:34.623449 dv-cinder-843309-3-iscsi devstack@n-api.service[117831]: lock engine: pthread robust mutexes Jun 30 09:59:34.625135 dv-cinder-843309-3-iscsi devstack@n-api.service[117831]: thunder lock: enabled Jun 30 09:59:34.625135 dv-cinder-843309-3-iscsi devstack@n-api.service[117831]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 30 09:59:34.625135 dv-cinder-843309-3-iscsi devstack@n-api.service[117831]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 30 09:59:34.676778 dv-cinder-843309-3-iscsi devstack@n-api.service[117831]: Python main interpreter initialized at 0x5605260099c0 Jun 30 09:59:34.676778 dv-cinder-843309-3-iscsi devstack@n-api.service[117831]: python threads support enabled Jun 30 09:59:34.676778 dv-cinder-843309-3-iscsi devstack@n-api.service[117831]: your server socket listen backlog is limited to 100 connections Jun 30 09:59:34.676778 dv-cinder-843309-3-iscsi devstack@n-api.service[117831]: your mercy for graceful operations on workers is 90 seconds Jun 30 09:59:34.677262 dv-cinder-843309-3-iscsi devstack@n-api.service[117831]: mapped 403077 bytes (393 KB) for 2 cores Jun 30 09:59:34.677262 dv-cinder-843309-3-iscsi devstack@n-api.service[117831]: *** Operational MODE: preforking *** Jun 30 09:59:34.677501 dv-cinder-843309-3-iscsi devstack@n-api.service[117831]: *** uWSGI is running in multiple interpreter mode *** Jun 30 09:59:34.677501 dv-cinder-843309-3-iscsi devstack@n-api.service[117831]: spawned uWSGI master process (pid: 117831) Jun 30 09:59:34.677686 dv-cinder-843309-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 30 09:59:34.678387 dv-cinder-843309-3-iscsi devstack@n-api.service[117831]: spawned uWSGI worker 1 (pid: 117846, cores: 1) Jun 30 09:59:34.678623 dv-cinder-843309-3-iscsi devstack@n-api.service[117831]: spawned uWSGI worker 2 (pid: 117847, cores: 1) Jun 30 09:59:34.678758 dv-cinder-843309-3-iscsi devstack@n-api.service[117831]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 30 09:59:35.336253 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 30 09:59:35.344838 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 30 09:59:36.520981 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 09:59:36.520981 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: from cryptography.utils import int_from_bytes Jun 30 09:59:36.521852 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 09:59:36.521852 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: from cryptography.utils import int_from_bytes Jun 30 09:59:36.534634 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 09:59:36.534634 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: from cryptography.utils import int_from_bytes Jun 30 09:59:36.535217 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 09:59:36.535217 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: from cryptography.utils import int_from_bytes Jun 30 09:59:38.869139 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 09:59:38.869736 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 09:59:38.870052 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 09:59:38.870239 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 09:59:38.870489 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 09:59:38.870866 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.871220 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.871545 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.871860 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.872223 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.872535 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.873112 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.873446 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.873766 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.874043 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.874365 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.874682 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843309-3-iscsi {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.875002 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.875291 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.875621 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.875915 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.876238 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.876553 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.876855 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.877358 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.878800 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.878800 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.878800 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.879451 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.879451 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.879954 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.879954 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.880364 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.880602 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.880862 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.881251 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843309-3-iscsi {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.881569 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.881873 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.882194 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.882606 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.882937 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.883233 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.883530 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.883922 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.884206 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.884547 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.884872 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.885178 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.885512 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.885803 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.886105 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.886387 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.886716 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.887044 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.887310 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.887560 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.887861 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.888224 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.888569 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.888901 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.889136 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.889385 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.889693 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.890007 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.890294 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.890615 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.890911 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.891212 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.891510 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.891808 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.892154 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.892459 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.892775 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.893092 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.893408 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.893707 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.894035 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.894436 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.894681 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.894993 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.895349 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.895680 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.896012 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.896312 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.896638 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.896950 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.897264 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.897565 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.897893 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.898226 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.898523 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.898770 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.899066 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.899368 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.899679 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.900016 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.900320 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.900660 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.900825 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 09:59:38.901347 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.901504 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 09:59:38.901650 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.901650 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.901962 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 09:59:38.902112 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.902339 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 09:59:38.902493 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.902637 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 09:59:38.902777 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.902948 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.903095 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.903248 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.903400 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.903539 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.903697 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.904097 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.904420 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.904420 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.904708 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.904858 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.905003 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.905160 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.905420 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.905572 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.905739 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.906030 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.906184 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.906334 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.906481 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.906620 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.906758 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.906908 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.907046 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843309-3-iscsi {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.907185 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.907322 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.907470 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.907608 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.907766 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.907992 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.908148 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.908373 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.908517 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.908664 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.908817 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.908964 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.909148 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.909292 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.909430 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.909581 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.909750 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.909750 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.910019 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.910155 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.910302 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.910456 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.910605 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.910907 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.911067 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.911214 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.911404 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.911554 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.911708 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.911856 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.912031 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.912181 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.912329 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.912476 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.912622 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.912761 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.912906 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.913052 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.913204 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843309-3-iscsi {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.913350 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.913498 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.913654 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.913804 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.913961 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.914106 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.914255 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.914255 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.914707 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.914862 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.915001 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.915138 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.915285 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.915448 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.915689 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.915846 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.916008 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.916158 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.916306 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.916461 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.916611 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.916765 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.916911 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.917050 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.917188 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.917331 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.917476 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.917635 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.917790 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.917935 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.918080 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.918223 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.918397 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.918609 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.918764 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.918903 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.919048 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.919197 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.919349 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.919349 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.919850 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.920014 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.920165 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.920304 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.920455 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.920790 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.921148 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.921148 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.921548 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.921548 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.921835 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.921994 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.922141 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.922287 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.922434 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.922582 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.922737 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.922930 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.923080 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.923228 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.923379 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.923529 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.923529 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.923809 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.923997 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.924144 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.924296 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.924450 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.924770 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.924920 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.925061 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.925206 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.925355 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.925493 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.925630 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.925877 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.926035 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.926182 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.926331 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.926468 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.926606 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.926743 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.926743 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.927010 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.927010 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.927298 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.927445 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.927591 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.927591 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.927909 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.928066 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.928214 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.928352 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.928501 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.928729 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.928892 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.929032 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.929177 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.929330 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.929475 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.929629 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.929783 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.929932 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.930078 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.930224 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.930368 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.930513 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.930659 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.930803 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.930970 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.931246 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.931398 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.931620 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.931761 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.931977 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.932122 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.932259 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.932405 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.932558 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.932696 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.932841 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.932979 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.933123 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.933272 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.933424 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.933561 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.933697 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.933844 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.933989 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.934126 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.934275 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.934422 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.934569 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.934735 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.935249 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.935418 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.935725 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.935902 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.936130 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.936287 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.936446 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.936606 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.936754 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.936902 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.937041 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.937178 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.937315 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.937462 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.937611 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.937750 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.937894 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.938040 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.938186 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.938335 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.938483 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.938622 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.938842 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.938996 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.939143 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.939282 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.939419 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.939556 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.939701 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.939701 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.940047 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.940195 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.940360 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.940508 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.940646 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.940804 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.940943 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.941088 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.941368 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.941519 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.941668 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.941817 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.941955 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.942093 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.942250 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.942396 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.942549 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.942695 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.942843 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.942993 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.943138 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.943283 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.943431 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.943569 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.943706 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.943844 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.944016 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.944168 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.944319 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.944466 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.944612 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.944758 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.944915 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.945232 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.945383 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.945531 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.945669 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.945814 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.945954 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.946121 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.946372 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.946524 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.946664 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.946809 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.946954 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.947102 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.947248 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.947386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.947523 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 09:59:38.947660 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.948128 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.948294 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.948436 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.948592 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.948737 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.948958 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.949111 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.949259 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.949399 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.949550 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.949697 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.949835 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.949980 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.950127 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.950411 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.950582 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.950795 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.950945 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.951104 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.951245 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.951542 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.951688 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.951827 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.952004 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.952157 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.952298 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.952444 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.952582 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.952739 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.952888 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.952888 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.953164 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.953304 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.953441 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.953578 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.953729 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.953874 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.954020 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.954158 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.954303 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.954449 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.954612 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.954760 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.954898 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.955068 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.955386 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.955532 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.955680 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.955820 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.956004 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.956162 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.956301 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.956559 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.956715 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.956864 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.957004 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.957148 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.957296 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.957445 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.957592 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.957739 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.957885 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.958034 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.958180 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.958401 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.958605 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.958767 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.958906 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.959142 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.959286 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.959434 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.959575 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.959721 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.959721 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.960046 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.960282 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.960442 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.960582 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.960721 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.961231 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.961388 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.961388 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.961846 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.961846 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.962127 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.962266 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.962411 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.962563 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.962711 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.962849 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.962986 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.963130 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.963289 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.963438 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.963576 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.963720 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.963885 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.964039 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.964190 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.964339 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.964478 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.964624 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.964771 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.964910 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.965072 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.965219 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.965543 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.965700 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.965848 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.965987 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.966151 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.966334 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.966481 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.966724 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.966873 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.967013 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.967167 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.967319 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.967459 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.967596 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.968167 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.968325 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.968484 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.968630 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.968768 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.968905 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.969043 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.969282 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.969435 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.969581 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.969735 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.969874 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.970012 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.970221 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.970375 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.970525 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.970673 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.970820 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.970958 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.971105 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.971245 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.971390 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.971528 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.971842 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.972007 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.972161 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.972301 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.972439 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.972577 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.972714 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.972872 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.973017 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.973165 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.973304 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.973450 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.973590 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.973757 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.973897 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.974035 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.974174 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.974311 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.974456 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.974603 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.974754 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.974900 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.975045 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.975184 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.975330 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.975598 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.975838 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.976019 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.976168 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.976307 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.976456 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.976595 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.976752 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.976984 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.977128 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.977281 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.977435 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.977574 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.977725 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.977863 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.978001 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.978146 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.978298 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.978439 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.978439 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.978709 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.978846 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.978990 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.979143 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.979310 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.979525 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.979679 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.979818 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.980019 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.980169 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.980309 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.980454 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.980595 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.980732 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.980883 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.981021 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.981170 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.981309 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.981476 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.981624 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.981782 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.982361 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.982503 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.982643 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.982870 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.983025 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.983172 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.983323 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.983462 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.983462 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.983747 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.983930 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.984177 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.984318 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.984457 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.984609 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.984759 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.984898 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.985036 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.985173 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.985310 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.985461 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.985691 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.985870 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.986122 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.986273 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.986420 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.986568 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.986716 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.986867 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.987024 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.987260 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.987490 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.987639 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.987786 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.987953 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.988099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.988251 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.988399 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.988546 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.988685 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.988830 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.988970 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.989117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.989288 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.989528 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.989748 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.989890 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.990182 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.990329 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.990489 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.990637 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.990775 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.990913 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.991051 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.991203 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.991342 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.991491 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.991630 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.991767 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.991942 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.992186 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.992398 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.992550 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.992689 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.992835 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.992835 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.993121 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.993261 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.993407 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.993546 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.993684 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.993820 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.993966 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.994105 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.994263 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.994489 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.994644 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.994800 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.994939 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.995083 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.995230 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.995369 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.995514 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.995678 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.995904 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.996063 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.996310 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.996480 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.996628 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.996778 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.996934 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.997074 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.997212 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.997352 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.997539 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.997765 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.997919 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.998062 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.998341 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.998499 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.998661 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.998801 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.998939 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.999092 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.999234 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.999380 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.999528 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.999683 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:38.999984 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.000164 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.000408 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.000576 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.000744 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.000907 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.001054 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.001212 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.001358 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.001522 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.001675 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.001827 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.001979 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.002149 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.002149 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.002534 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.002689 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.002853 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.003007 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.003154 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.003306 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.003462 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.003610 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.003763 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.003927 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.004080 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.004224 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.004381 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.004535 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.004681 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.004844 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.004998 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.005145 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.005304 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.005451 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.005604 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.005749 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.005910 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.006135 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.006311 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.006557 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.006706 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.006851 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.007009 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.007165 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.007318 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.007464 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.007608 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.007781 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.008038 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.008420 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.008592 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.008747 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.008902 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.009064 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.009247 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.009422 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.009570 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.009722 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.009869 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.010102 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.010265 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.010427 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.010647 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.010799 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.010953 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.011099 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.011252 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.011482 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.011587 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.011683 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.011776 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.011972 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.012093 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.012181 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.012265 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.012372 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.012540 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.012641 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.012641 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.012901 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.013001 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.013093 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.013439 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.013545 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.013619 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.013705 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.013798 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.013798 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.013951 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.014044 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.014129 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.014219 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.014310 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.014395 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.014478 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.014568 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.014659 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.014744 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.014845 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.015128 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.015218 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.015301 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.015385 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.015468 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.015561 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.015708 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.015835 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.015991 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.016142 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.016345 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.016487 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.016722 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.016859 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.016994 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.017127 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.017252 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.017384 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.017508 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.017639 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.017771 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.017771 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.017771 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.017771 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.018348 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.018475 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.018475 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.018475 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.018475 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.018475 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.018475 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.019191 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.019317 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.019317 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.019317 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.019317 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.019317 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.020051 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.020270 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.020270 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.020516 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.020664 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.020857 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.020984 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.020984 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.021242 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.021375 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.021375 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.021627 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.021759 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.021884 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.022021 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.022021 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.022265 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.022397 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.022397 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.022632 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.022765 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.022765 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.023017 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.023150 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.023150 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.023392 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.023526 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.023652 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.023776 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.023776 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.024027 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.024166 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.024166 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.024417 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.024550 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.024550 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.024793 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.024933 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.025059 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.025264 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.025264 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.025506 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.025631 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.025631 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.025886 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.026009 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.026009 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.026248 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.026461 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.026599 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.026741 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.026741 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.026741 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.027173 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.027317 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.027317 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.027551 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.027673 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.027797 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.027984 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.027984 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.028245 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.028449 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.028584 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.028717 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.028945 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.029088 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.029271 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.029491 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.029687 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.029938 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.030075 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.030304 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.030448 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.030582 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.030913 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.031061 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.031198 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.031323 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.031476 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.031744 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.031897 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.032110 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.032355 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.032486 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.032709 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.032836 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.033010 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.033260 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.033397 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.033611 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.033747 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.033912 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.034152 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.034280 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.034531 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.034666 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.034848 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.035055 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.035192 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.035455 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.035593 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.035774 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.036143 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.036284 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.036431 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.036629 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.036767 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.037015 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.037151 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.037305 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.037443 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.037609 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.037869 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.038006 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.038239 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.038377 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.038595 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.038812 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.038948 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.039167 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.039304 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.039491 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.039664 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.039802 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.040111 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.040241 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.040445 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.040577 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.040738 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.041022 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.041159 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.041327 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.041463 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.041628 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.041886 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.042015 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.042215 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.042362 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.042520 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.042808 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.042945 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.043113 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.043294 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.043422 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.043850 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.044071 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.044209 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.044345 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.044511 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.044647 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.044775 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.044957 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.045120 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.045259 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.045546 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.045690 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.045883 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.046147 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.046359 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.046486 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.046626 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.046810 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.046997 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.047233 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.047417 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.047722 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.048071 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.048225 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.048413 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.048588 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.048697 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.048907 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.049022 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.049266 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.049386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.049577 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.049675 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.049887 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.049999 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.050196 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.050373 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.050536 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.050808 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.050912 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.051116 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.051293 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.051445 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.051614 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.052015 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.052172 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.052334 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.052477 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.052644 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.052792 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.052944 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.053087 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.053237 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.053380 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.053536 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.053686 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.053838 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.053995 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.054146 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.054296 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.054446 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.054588 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.054736 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.054893 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.055037 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.055181 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.055330 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.055490 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.055634 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.055790 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.055952 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.056184 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.056350 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.056580 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.056728 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.056881 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.057079 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.057237 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.057483 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.057648 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.057835 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.057997 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.058141 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.058298 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.058447 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.058597 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.058752 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.058902 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.059044 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.059185 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.059351 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.059598 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.059746 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.059921 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.060127 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.060279 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.060421 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.060577 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.060724 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.060874 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.061746 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.061906 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.062065 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.062219 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.062363 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.062504 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.062730 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.062875 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.063017 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.063159 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.063300 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.063450 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.063607 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.063757 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.063920 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.064081 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.064224 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.064224 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.064519 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.064519 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.064796 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.064944 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.065094 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.065260 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.065411 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.065561 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.065710 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.065851 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.066004 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.066160 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.066412 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.066562 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.066711 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.066711 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.066997 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.067675 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.067675 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.068000 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.068145 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.068286 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.068438 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.068606 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.068758 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.068900 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.069041 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.069190 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.069345 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.069345 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.069644 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.069893 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.070040 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.070190 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.070343 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.070343 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.070663 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.070816 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.070965 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.071115 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.071266 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.071266 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.071542 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.071683 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.071824 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.072004 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.072160 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.072311 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.072463 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.072612 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.072762 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.073252 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.073252 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.073528 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.073670 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.073811 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.073953 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.074102 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.074251 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.074392 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.074540 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.074540 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.074839 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.074995 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.075153 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.075295 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.075444 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.075584 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.075772 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.076007 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.076231 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.076399 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.076622 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.076780 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.076948 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.077090 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.077239 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.077380 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.077537 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.077679 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.077829 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.077980 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.078130 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.078272 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.078412 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.078560 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.078725 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.078867 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.079008 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.079149 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.079290 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.079436 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.079587 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.079729 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.079948 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.080109 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.080262 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.080418 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.080560 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.080729 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.080882 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.081030 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.081172 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.081323 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.081464 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.081604 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.081744 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.081894 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.082043 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.082194 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.082336 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.082485 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.082637 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.082778 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.082927 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.083079 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.083229 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.083379 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.083528 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.083670 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.083840 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.084142 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.084291 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.084446 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.084588 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.084747 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.084908 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.085050 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.085190 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.085329 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.085514 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.085662 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.085817 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.085969 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.086111 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.086254 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.086403 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.086570 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.086745 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.086896 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.087037 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.087178 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.087328 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.087484 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.087627 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.087766 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.087965 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.088122 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.088263 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.088413 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.088567 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.088709 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.088850 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.088990 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.089131 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.089285 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.089427 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.089576 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.089727 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.089877 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.090027 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.090168 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.090329 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.090471 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.090612 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.090763 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.090920 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.091063 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.091204 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.091480 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.091634 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.091963 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.092202 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.092202 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.092484 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.092637 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.092780 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.092930 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.093080 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.093223 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.093363 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.093512 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.093662 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.093814 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.093955 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.094102 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.094245 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.094398 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.094541 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.094690 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.094833 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.094982 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.095468 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.095638 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.095787 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.095974 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.096133 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.096275 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.096433 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.096583 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.096746 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.096895 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.097046 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.097186 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.097328 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.097477 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.097628 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.097770 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.097911 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.098053 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.098192 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.098332 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.098481 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.098640 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.098781 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.098923 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.099073 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.099228 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.099369 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.099518 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.099668 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.099812 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.099989 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.100148 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.100304 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.100468 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.100610 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.100757 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.100966 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.101135 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.101277 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.101418 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.101566 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.101714 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.101857 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.102012 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.102162 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.102310 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.102466 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.102608 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.102763 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.102912 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.103054 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.103194 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.103333 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.103482 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.103638 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.103780 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.103954 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.104688 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.104855 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.105018 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.105175 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.105319 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.105319 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.105594 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.105742 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.105891 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.106048 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.106205 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.106390 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.106543 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.106686 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.106686 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.107205 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.107353 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.107497 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.107639 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.107780 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.107964 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.108121 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.108309 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.108464 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.108606 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.108748 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.108898 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.109052 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.109195 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.109195 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.109470 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.109620 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.109771 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.109921 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.110070 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.110220 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.110362 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.110512 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.110512 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.110790 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.110975 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.111137 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.111299 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.111458 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.111610 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.111753 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.111942 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.111942 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.112218 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.112419 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.112574 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.112726 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.112880 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.113023 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.113178 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.113327 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.113476 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.113630 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.113799 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.113942 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.114093 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.114236 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.114236 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.114509 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.114668 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.114824 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.114966 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.115115 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.115256 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.115396 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.115545 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.115701 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.115844 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.116010 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.116165 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.116316 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.116469 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.116624 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.116767 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.116767 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.117042 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.117192 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.117343 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.117485 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.117633 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.117782 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.117950 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.118229 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.118386 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.118540 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.118689 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.118831 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.118974 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.119115 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.119313 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.119475 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.119626 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.119767 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.119993 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.120151 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.120304 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.120460 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.120603 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.120744 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.120892 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.121124 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.121280 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 09:59:39.121422 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.121422 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.121746 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.122070 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.122374 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.122731 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.123043 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.123348 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.123649 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.123993 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.124301 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.124603 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.124918 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.125224 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.125758 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.126103 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.126416 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.126738 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.127060 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.127373 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.127674 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.128050 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.128400 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.128621 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.128932 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.129240 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.129541 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.129840 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.130143 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.130455 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.130754 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.131057 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.131355 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.131715 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.131997 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.132296 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.132594 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.132905 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.133254 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.133491 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.133791 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.134089 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.134394 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.134691 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.135059 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.135420 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.135782 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.136221 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.136530 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.136923 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.137245 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.137548 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.137850 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.138308 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.139302 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.139628 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.139966 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.140296 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.140629 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.140946 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.141497 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.141828 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.142147 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.142482 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.142811 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.143172 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.143670 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.144000 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.144325 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.144635 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.144946 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.145254 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.145565 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.145873 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.146182 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.146489 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.146796 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.147104 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.147411 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.147715 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.148045 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.148400 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.148661 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.149000 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.149314 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.149629 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.149942 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.150294 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.150587 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.150894 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.151202 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.151526 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.151813 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.152164 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.152474 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.152775 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.153292 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.153605 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.153998 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.154305 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.154611 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.154928 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.155245 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.155551 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.155885 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.156193 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.156518 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.156853 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.157180 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.157498 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.157799 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.158099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.158401 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.158702 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.159069 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.159319 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.159616 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.160064 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.160378 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.160679 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.160981 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.161280 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.161637 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.161880 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.162175 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.162606 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.162908 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.163207 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.163513 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.163811 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.164139 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.164436 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.164738 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.165035 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.165333 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.165632 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.165960 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.166292 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.166605 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.166927 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.167239 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.167557 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.167864 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.168289 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.168675 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.169017 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.169975 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.169975 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.170312 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.170463 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.170888 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.171199 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.171507 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.171819 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.172166 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.172495 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.172797 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.173117 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.173436 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.173758 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.174074 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.174381 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.174704 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.175011 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.175314 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.175652 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.176038 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.176482 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.176817 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.177135 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.177567 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.177942 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.178852 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.179058 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.179438 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.179789 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.180131 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.180478 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.180805 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.181123 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.181623 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.182480 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 09:59:39.182579 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO dbcounter [None req-5f8644d5-b09e-4437-ae16-4afc88a2a41e None None] Registered counter for database nova_api Jun 30 09:59:39.182730 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 09:59:39.203222 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_db.sqlalchemy.engines [None req-5f8644d5-b09e-4437-ae16-4afc88a2a41e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117846) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 09:59:39.209869 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writer thread running {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 09:59:39.248500 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO dbcounter [None req-2aa873eb-e83a-4152-aeb9-5e25802bdc67 None None] Registered counter for database nova_api Jun 30 09:59:39.265382 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.context [None req-5f8644d5-b09e-4437-ae16-4afc88a2a41e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c89fa87a-864c-4617-9f03-4ca146aad90b(cell1) {{(pid=117846) load_cells /opt/stack/nova/nova/context.py:464}} Jun 30 09:59:39.269556 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5f8644d5-b09e-4437-ae16-4afc88a2a41e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 09:59:39.269695 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_db.sqlalchemy.engines [None req-2aa873eb-e83a-4152-aeb9-5e25802bdc67 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117847) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 09:59:39.271143 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5f8644d5-b09e-4437-ae16-4afc88a2a41e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 09:59:39.271990 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5f8644d5-b09e-4437-ae16-4afc88a2a41e None None] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 09:59:39.273980 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5f8644d5-b09e-4437-ae16-4afc88a2a41e None None] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 09:59:39.276027 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO dbcounter [None req-5f8644d5-b09e-4437-ae16-4afc88a2a41e None None] Registered counter for database nova_cell0 Jun 30 09:59:39.280424 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO dbcounter [None req-5f8644d5-b09e-4437-ae16-4afc88a2a41e None None] Registered counter for database nova_cell1 Jun 30 09:59:39.283003 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writer thread running {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 09:59:39.290804 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_db.sqlalchemy.engines [None req-5f8644d5-b09e-4437-ae16-4afc88a2a41e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117846) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 09:59:39.290804 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_db.sqlalchemy.engines [None req-5f8644d5-b09e-4437-ae16-4afc88a2a41e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117846) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 09:59:39.295104 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writer thread running {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 09:59:39.340476 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.context [None req-2aa873eb-e83a-4152-aeb9-5e25802bdc67 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c89fa87a-864c-4617-9f03-4ca146aad90b(cell1) {{(pid=117847) load_cells /opt/stack/nova/nova/context.py:464}} Jun 30 09:59:39.344963 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2aa873eb-e83a-4152-aeb9-5e25802bdc67 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 09:59:39.346562 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2aa873eb-e83a-4152-aeb9-5e25802bdc67 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 09:59:39.347372 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2aa873eb-e83a-4152-aeb9-5e25802bdc67 None None] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 09:59:39.349407 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2aa873eb-e83a-4152-aeb9-5e25802bdc67 None None] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 09:59:39.351476 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO dbcounter [None req-2aa873eb-e83a-4152-aeb9-5e25802bdc67 None None] Registered counter for database nova_cell0 Jun 30 09:59:39.355668 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO dbcounter [None req-2aa873eb-e83a-4152-aeb9-5e25802bdc67 None None] Registered counter for database nova_cell1 Jun 30 09:59:39.365690 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_db.sqlalchemy.engines [None req-2aa873eb-e83a-4152-aeb9-5e25802bdc67 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117847) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 09:59:39.366575 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_db.sqlalchemy.engines [None req-2aa873eb-e83a-4152-aeb9-5e25802bdc67 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117847) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 09:59:39.375198 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writer thread running {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 09:59:39.375483 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writer thread running {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 09:59:39.436336 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writer thread running {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 09:59:39.446244 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO dbcounter [None req-5f8644d5-b09e-4437-ae16-4afc88a2a41e None None] Registered counter for database nova_cell0 Jun 30 09:59:39.453995 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_db.sqlalchemy.engines [None req-5f8644d5-b09e-4437-ae16-4afc88a2a41e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117846) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 09:59:39.459234 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writer thread running {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 09:59:39.524283 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO dbcounter [None req-2aa873eb-e83a-4152-aeb9-5e25802bdc67 None None] Registered counter for database nova_cell0 Jun 30 09:59:39.531416 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_db.sqlalchemy.engines [None req-2aa873eb-e83a-4152-aeb9-5e25802bdc67 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117847) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 09:59:39.536144 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writer thread running {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 09:59:39.774443 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: WARNING keystonemiddleware.auth_token [None req-5f8644d5-b09e-4437-ae16-4afc88a2a41e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 09:59:39.781831 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: WARNING keystonemiddleware.auth_token [None req-5f8644d5-b09e-4437-ae16-4afc88a2a41e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 09:59:39.850303 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: WARNING keystonemiddleware.auth_token [None req-2aa873eb-e83a-4152-aeb9-5e25802bdc67 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 09:59:39.857751 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: WARNING keystonemiddleware.auth_token [None req-2aa873eb-e83a-4152-aeb9-5e25802bdc67 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 09:59:40.128016 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: WARNING keystonemiddleware.auth_token [None req-5f8644d5-b09e-4437-ae16-4afc88a2a41e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 09:59:40.134269 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: WARNING keystonemiddleware.auth_token [None req-5f8644d5-b09e-4437-ae16-4afc88a2a41e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 09:59:40.139931 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5605260099c0 pid: 117846 (default app) Jun 30 09:59:40.198390 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: WARNING keystonemiddleware.auth_token [None req-2aa873eb-e83a-4152-aeb9-5e25802bdc67 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 09:59:40.204619 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: WARNING keystonemiddleware.auth_token [None req-2aa873eb-e83a-4152-aeb9-5e25802bdc67 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 09:59:40.209998 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5605260099c0 pid: 117847 (default app) Jun 30 10:00:21.565868 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=3 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:00:21.569900 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=3 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:00:21.573770 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=3 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:00:21.575616 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=3 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:00:21.706715 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_api:SELECT=3 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:00:21.707552 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell0:SELECT=3 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:00:21.713144 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell1:SELECT=3 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:00:21.715517 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell0:SELECT=3 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:00:23.045311 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-3a95d67d-f0c8-4d51-a83b-b20d5ff6be35 tempest-VolumesNegativeTest-138105837 tempest-VolumesNegativeTest-138105837-project] Action: 'create', calling method: .version_select at 0x7fc222365430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1127962763", "metadata": {"Type": "work"}}} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:00:23.063600 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-3a95d67d-f0c8-4d51-a83b-b20d5ff6be35 tempest-VolumesNegativeTest-138105837 tempest-VolumesNegativeTest-138105837-project] Request method failure captured: Jun 30 10:00:23.063600 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 30 10:00:23.063600 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept: application/json Jun 30 10:00:23.063600 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept-Encoding: identity Jun 30 10:00:23.063600 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Connection: close Jun 30 10:00:23.063600 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Length: 122 Jun 30 10:00:23.063600 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Type: application/json Jun 30 10:00:23.063600 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Host: 10.222.0.16 Jun 30 10:00:23.063600 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Openstack-System-Scope: None Jun 30 10:00:23.063600 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: User-Agent: python-urllib3/1.26.9 Jun 30 10:00:23.063600 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Auth-Token: gAAAAABivXQ1yHJT6-3bd5FzTOFnLcuadZgpscdT_BbCugE60Su193pVNerSJP9UuMvX43HSB8Rr2zjqD9gtFY16fUzMQppU2r3RnpT9mAEZGjdC6iOoIyHyaeP-LmzESUlQwwlQUJxsok8_GvCWYnAfih8z4xBj2PVY8_1eJbBznjb2GelFXlI Jun 30 10:00:23.063600 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Id: None Jun 30 10:00:23.063600 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Name: None Jun 30 10:00:23.063600 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Identity-Status: Confirmed Jun 30 10:00:23.063600 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Is-Admin-Project: True Jun 30 10:00:23.063600 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Id: default Jun 30 10:00:23.063600 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Name: Default Jun 30 10:00:23.063600 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Id: f00f2c2d2dea47e4b868ba84f0dbf5ea Jun 30 10:00:23.063600 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Name: tempest-VolumesNegativeTest-138105837 Jun 30 10:00:23.063600 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Role: reader,member Jun 30 10:00:23.063600 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Roles: reader,member Jun 30 10:00:23.065314 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f00f2c2d2dea47e4b868ba84f0dbf5ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f00f2c2d2dea47e4b868ba84f0dbf5ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f00f2c2d2dea47e4b868ba84f0dbf5ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f00f2c2d2dea47e4b868ba84f0dbf5ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:00:23.065314 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant: tempest-VolumesNegativeTest-138105837 Jun 30 10:00:23.065314 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Id: f00f2c2d2dea47e4b868ba84f0dbf5ea Jun 30 10:00:23.065314 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Name: tempest-VolumesNegativeTest-138105837 Jun 30 10:00:23.065314 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User: tempest-VolumesNegativeTest-138105837-project Jun 30 10:00:23.065314 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Id: default Jun 30 10:00:23.065314 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Name: Default Jun 30 10:00:23.065314 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Id: c8b9ea99092844d59797bbae13a6d362 Jun 30 10:00:23.065314 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Name: tempest-VolumesNegativeTest-138105837-project Jun 30 10:00:23.065314 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Jun 30 10:00:23.065314 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1127962763", "metadata": {"Type": "work"}}} Jun 30 10:00:23.065314 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: method: Jun 30 10:00:23.065314 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 30 10:00:23.066287 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1127962763', 'metadata': {'Type': 'work'}}}} Jun 30 10:00:23.066287 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:00:23.066287 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:00:23.066287 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 30 10:00:23.066287 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 30 10:00:23.066287 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 30 10:00:23.066287 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise error Jun 30 10:00:23.066287 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 30 10:00:23.066287 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:00:23.066287 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 30 10:00:23.066287 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 30 10:00:23.066287 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:00:23.066287 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 30 10:00:23.066287 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi '#$%' Jun 30 10:00:23.066287 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:00:23.066287 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:00:23.066287 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:00:23.066287 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:00:23.066287 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:00:23.066287 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:00:23.066287 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:00:23.066287 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:00:23.068399 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 10:00:23.068399 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 10:00:23.068399 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:00:23.068399 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:00:23.068399 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 30 10:00:23.068399 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 30 10:00:23.068399 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 30 10:00:23.068399 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 30 10:00:23.068399 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 30 10:00:23.068399 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 30 10:00:23.068399 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 30 10:00:23.068399 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:00:23.068399 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:00:23.068399 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:00:23.068399 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:00:23.068399 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:00:23.068399 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:00:23.068399 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 30 10:00:23.068399 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 30 10:00:23.069932 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 30 10:00:23.069932 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:00:23.071275 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-3a95d67d-f0c8-4d51-a83b-b20d5ff6be35 tempest-VolumesNegativeTest-138105837 tempest-VolumesNegativeTest-138105837-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:00:23.073004 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-3a95d67d-f0c8-4d51-a83b-b20d5ff6be35 tempest-VolumesNegativeTest-138105837 tempest-VolumesNegativeTest-138105837-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.385260 Jun 30 10:00:23.074702 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 1/1] 10.222.0.16 () {60 vars in 1155 bytes} [Thu Jun 30 10:00:21 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1390 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 30 10:00:23.084825 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-5f636536-bd18-4419-a4d1-0aa6603714ba tempest-VolumesNegativeTest-138105837 tempest-VolumesNegativeTest-138105837-project] Action: 'create', calling method: .version_select at 0x7fc2222e9790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1202430007", "metadata": {"Type": "work"}}} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:00:23.099610 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-5f636536-bd18-4419-a4d1-0aa6603714ba tempest-VolumesNegativeTest-138105837 tempest-VolumesNegativeTest-138105837-project] Request method failure captured: Jun 30 10:00:23.099610 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 30 10:00:23.099610 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept: application/json Jun 30 10:00:23.099610 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept-Encoding: identity Jun 30 10:00:23.099610 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Connection: close Jun 30 10:00:23.099610 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Length: 120 Jun 30 10:00:23.099610 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Type: application/json Jun 30 10:00:23.099610 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Host: 10.222.0.16 Jun 30 10:00:23.099610 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Openstack-System-Scope: None Jun 30 10:00:23.099610 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: User-Agent: python-urllib3/1.26.9 Jun 30 10:00:23.099610 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Auth-Token: gAAAAABivXQ1yHJT6-3bd5FzTOFnLcuadZgpscdT_BbCugE60Su193pVNerSJP9UuMvX43HSB8Rr2zjqD9gtFY16fUzMQppU2r3RnpT9mAEZGjdC6iOoIyHyaeP-LmzESUlQwwlQUJxsok8_GvCWYnAfih8z4xBj2PVY8_1eJbBznjb2GelFXlI Jun 30 10:00:23.099610 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Id: None Jun 30 10:00:23.099610 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Name: None Jun 30 10:00:23.099610 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Identity-Status: Confirmed Jun 30 10:00:23.099610 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Is-Admin-Project: True Jun 30 10:00:23.099610 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Id: default Jun 30 10:00:23.099610 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Name: Default Jun 30 10:00:23.099610 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Id: f00f2c2d2dea47e4b868ba84f0dbf5ea Jun 30 10:00:23.099610 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Name: tempest-VolumesNegativeTest-138105837 Jun 30 10:00:23.099610 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Role: reader,member Jun 30 10:00:23.099610 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Roles: reader,member Jun 30 10:00:23.101196 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f00f2c2d2dea47e4b868ba84f0dbf5ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f00f2c2d2dea47e4b868ba84f0dbf5ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f00f2c2d2dea47e4b868ba84f0dbf5ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f00f2c2d2dea47e4b868ba84f0dbf5ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:00:23.101196 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant: tempest-VolumesNegativeTest-138105837 Jun 30 10:00:23.101196 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Id: f00f2c2d2dea47e4b868ba84f0dbf5ea Jun 30 10:00:23.101196 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Name: tempest-VolumesNegativeTest-138105837 Jun 30 10:00:23.101196 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User: tempest-VolumesNegativeTest-138105837-project Jun 30 10:00:23.101196 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Id: default Jun 30 10:00:23.101196 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Name: Default Jun 30 10:00:23.101196 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Id: c8b9ea99092844d59797bbae13a6d362 Jun 30 10:00:23.101196 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Name: tempest-VolumesNegativeTest-138105837-project Jun 30 10:00:23.101196 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Jun 30 10:00:23.101196 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1202430007", "metadata": {"Type": "work"}}} Jun 30 10:00:23.101196 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: method: Jun 30 10:00:23.101196 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 30 10:00:23.101968 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1202430007', 'metadata': {'Type': 'work'}}}} Jun 30 10:00:23.101968 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:00:23.101968 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:00:23.101968 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 30 10:00:23.101968 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 30 10:00:23.101968 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 30 10:00:23.101968 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise error Jun 30 10:00:23.101968 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 30 10:00:23.101968 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:00:23.101968 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 30 10:00:23.101968 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 30 10:00:23.101968 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:00:23.101968 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 30 10:00:23.101968 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi '0' Jun 30 10:00:23.101968 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:00:23.101968 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:00:23.101968 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:00:23.101968 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:00:23.101968 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:00:23.101968 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:00:23.101968 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:00:23.101968 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:00:23.103288 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 10:00:23.103288 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 10:00:23.103288 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:00:23.103288 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:00:23.103288 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 30 10:00:23.103288 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 30 10:00:23.103288 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 30 10:00:23.103288 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 30 10:00:23.103288 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 30 10:00:23.103288 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 30 10:00:23.103288 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 30 10:00:23.103288 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:00:23.103288 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:00:23.103288 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:00:23.103288 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:00:23.103288 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:00:23.103288 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:00:23.103288 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 30 10:00:23.103288 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 30 10:00:23.104496 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 30 10:00:23.104496 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:00:23.107999 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-5f636536-bd18-4419-a4d1-0aa6603714ba tempest-VolumesNegativeTest-138105837 tempest-VolumesNegativeTest-138105837-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:00:23.110310 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-5f636536-bd18-4419-a4d1-0aa6603714ba tempest-VolumesNegativeTest-138105837 tempest-VolumesNegativeTest-138105837-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.029750 Jun 30 10:00:23.112463 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 2/2] 10.222.0.16 () {60 vars in 1155 bytes} [Thu Jun 30 10:00:23 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 30 10:00:23.123097 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-01c4cea1-d778-457b-9c03-38f3587730f0 tempest-VolumesNegativeTest-138105837 tempest-VolumesNegativeTest-138105837-project] Action: 'create', calling method: .version_select at 0x7fc222365790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2111258957", "metadata": {"Type": "work"}}} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:00:23.140966 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-01c4cea1-d778-457b-9c03-38f3587730f0 tempest-VolumesNegativeTest-138105837 tempest-VolumesNegativeTest-138105837-project] Request method failure captured: Jun 30 10:00:23.140966 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 30 10:00:23.140966 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept: application/json Jun 30 10:00:23.140966 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept-Encoding: identity Jun 30 10:00:23.140966 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Connection: close Jun 30 10:00:23.140966 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Length: 119 Jun 30 10:00:23.140966 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Type: application/json Jun 30 10:00:23.140966 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Host: 10.222.0.16 Jun 30 10:00:23.140966 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Openstack-System-Scope: None Jun 30 10:00:23.140966 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: User-Agent: python-urllib3/1.26.9 Jun 30 10:00:23.140966 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Auth-Token: gAAAAABivXQ1yHJT6-3bd5FzTOFnLcuadZgpscdT_BbCugE60Su193pVNerSJP9UuMvX43HSB8Rr2zjqD9gtFY16fUzMQppU2r3RnpT9mAEZGjdC6iOoIyHyaeP-LmzESUlQwwlQUJxsok8_GvCWYnAfih8z4xBj2PVY8_1eJbBznjb2GelFXlI Jun 30 10:00:23.140966 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Id: None Jun 30 10:00:23.140966 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Name: None Jun 30 10:00:23.140966 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Identity-Status: Confirmed Jun 30 10:00:23.140966 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Is-Admin-Project: True Jun 30 10:00:23.140966 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Id: default Jun 30 10:00:23.140966 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Name: Default Jun 30 10:00:23.140966 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Id: f00f2c2d2dea47e4b868ba84f0dbf5ea Jun 30 10:00:23.140966 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Name: tempest-VolumesNegativeTest-138105837 Jun 30 10:00:23.140966 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Role: reader,member Jun 30 10:00:23.140966 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Roles: reader,member Jun 30 10:00:23.142526 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f00f2c2d2dea47e4b868ba84f0dbf5ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f00f2c2d2dea47e4b868ba84f0dbf5ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f00f2c2d2dea47e4b868ba84f0dbf5ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f00f2c2d2dea47e4b868ba84f0dbf5ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:00:23.142526 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant: tempest-VolumesNegativeTest-138105837 Jun 30 10:00:23.142526 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Id: f00f2c2d2dea47e4b868ba84f0dbf5ea Jun 30 10:00:23.142526 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Name: tempest-VolumesNegativeTest-138105837 Jun 30 10:00:23.142526 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User: tempest-VolumesNegativeTest-138105837-project Jun 30 10:00:23.142526 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Id: default Jun 30 10:00:23.142526 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Name: Default Jun 30 10:00:23.142526 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Id: c8b9ea99092844d59797bbae13a6d362 Jun 30 10:00:23.142526 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Name: tempest-VolumesNegativeTest-138105837-project Jun 30 10:00:23.142526 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Jun 30 10:00:23.142526 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2111258957", "metadata": {"Type": "work"}}} Jun 30 10:00:23.142526 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: method: Jun 30 10:00:23.142526 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 30 10:00:23.143433 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2111258957', 'metadata': {'Type': 'work'}}}} Jun 30 10:00:23.143433 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:00:23.143433 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:00:23.143433 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 30 10:00:23.143433 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 30 10:00:23.143433 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 30 10:00:23.143433 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise error Jun 30 10:00:23.143433 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 30 10:00:23.143433 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:00:23.143433 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 30 10:00:23.143433 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 30 10:00:23.143433 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:00:23.143433 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 30 10:00:23.143433 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi '' Jun 30 10:00:23.143433 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:00:23.143433 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:00:23.143433 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:00:23.143433 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:00:23.143433 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:00:23.143433 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:00:23.143433 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:00:23.143433 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:00:23.145390 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 10:00:23.145390 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 10:00:23.145390 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:00:23.145390 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:00:23.145390 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 30 10:00:23.145390 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 30 10:00:23.145390 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 30 10:00:23.145390 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 30 10:00:23.145390 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 30 10:00:23.145390 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 30 10:00:23.145390 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 30 10:00:23.145390 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:00:23.145390 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:00:23.145390 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:00:23.145390 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:00:23.145390 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:00:23.145390 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:00:23.145390 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 30 10:00:23.145390 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 30 10:00:23.146821 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 30 10:00:23.146821 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:00:23.149040 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-01c4cea1-d778-457b-9c03-38f3587730f0 tempest-VolumesNegativeTest-138105837 tempest-VolumesNegativeTest-138105837-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:00:23.150665 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-01c4cea1-d778-457b-9c03-38f3587730f0 tempest-VolumesNegativeTest-138105837 tempest-VolumesNegativeTest-138105837-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.032501 Jun 30 10:00:23.154376 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 3/3] 10.222.0.16 () {60 vars in 1155 bytes} [Thu Jun 30 10:00:23 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 30 10:00:23.163247 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-5bf601e9-8c58-4131-b273-f17067edd451 tempest-VolumesNegativeTest-138105837 tempest-VolumesNegativeTest-138105837-project] Calling method '.version_select at 0x7fc2222934c0>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:00:23.202118 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-84d34b5c-b9f6-4f8e-9631-e24e72082bad tempest-VolumesGetTestJSON-940258334 tempest-VolumesGetTestJSON-940258334-project] Action: 'create', calling method: .version_select at 0x7fc2223673a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-410139224", "metadata": {"Type": "work"}}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:00:24.376777 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.wsgi [None req-5bf601e9-8c58-4131-b273-f17067edd451 tempest-VolumesNegativeTest-138105837 tempest-VolumesNegativeTest-138105837-project] HTTP exception thrown: Volume tempest-invalid-2068132945 could not be found. Jun 30 10:00:24.380546 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-5bf601e9-8c58-4131-b273-f17067edd451 tempest-VolumesNegativeTest-138105837 tempest-VolumesNegativeTest-138105837-project] Request method failure captured: Jun 30 10:00:24.380546 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2068132945 HTTP/1.1 Jun 30 10:00:24.380546 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept: application/json Jun 30 10:00:24.380546 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept-Encoding: identity Jun 30 10:00:24.380546 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Connection: close Jun 30 10:00:24.380546 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Length: 0 Jun 30 10:00:24.380546 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Type: application/json Jun 30 10:00:24.380546 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Host: 10.222.0.16 Jun 30 10:00:24.380546 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Openstack-System-Scope: None Jun 30 10:00:24.380546 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: User-Agent: python-urllib3/1.26.9 Jun 30 10:00:24.380546 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Auth-Token: gAAAAABivXQ1yHJT6-3bd5FzTOFnLcuadZgpscdT_BbCugE60Su193pVNerSJP9UuMvX43HSB8Rr2zjqD9gtFY16fUzMQppU2r3RnpT9mAEZGjdC6iOoIyHyaeP-LmzESUlQwwlQUJxsok8_GvCWYnAfih8z4xBj2PVY8_1eJbBznjb2GelFXlI Jun 30 10:00:24.380546 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Id: None Jun 30 10:00:24.380546 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Name: None Jun 30 10:00:24.380546 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Identity-Status: Confirmed Jun 30 10:00:24.380546 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Is-Admin-Project: True Jun 30 10:00:24.380546 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Id: default Jun 30 10:00:24.380546 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Name: Default Jun 30 10:00:24.380546 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Id: f00f2c2d2dea47e4b868ba84f0dbf5ea Jun 30 10:00:24.380546 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Name: tempest-VolumesNegativeTest-138105837 Jun 30 10:00:24.380546 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Role: reader,member Jun 30 10:00:24.380546 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Roles: reader,member Jun 30 10:00:24.382137 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f00f2c2d2dea47e4b868ba84f0dbf5ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f00f2c2d2dea47e4b868ba84f0dbf5ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f00f2c2d2dea47e4b868ba84f0dbf5ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f00f2c2d2dea47e4b868ba84f0dbf5ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:00:24.382137 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant: tempest-VolumesNegativeTest-138105837 Jun 30 10:00:24.382137 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Id: f00f2c2d2dea47e4b868ba84f0dbf5ea Jun 30 10:00:24.382137 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Name: tempest-VolumesNegativeTest-138105837 Jun 30 10:00:24.382137 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User: tempest-VolumesNegativeTest-138105837-project Jun 30 10:00:24.382137 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Id: default Jun 30 10:00:24.382137 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Name: Default Jun 30 10:00:24.382137 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Id: c8b9ea99092844d59797bbae13a6d362 Jun 30 10:00:24.382137 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Name: tempest-VolumesNegativeTest-138105837-project Jun 30 10:00:24.382137 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: method: Jun 30 10:00:24.382137 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: exception: Volume tempest-invalid-2068132945 could not be found. Jun 30 10:00:24.382137 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: action_args: {'id': 'tempest-invalid-2068132945'} Jun 30 10:00:24.382137 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:00:24.383101 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:00:24.383101 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 10:00:24.383101 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 10:00:24.383101 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 10:00:24.383101 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 10:00:24.383101 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 10:00:24.383101 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 10:00:24.383101 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 10:00:24.383101 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 10:00:24.383101 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 10:00:24.383101 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 10:00:24.383101 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 10:00:24.383101 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 10:00:24.383101 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 10:00:24.383101 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 10:00:24.383101 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2068132945 could not be found. (HTTP 404) (Request-ID: req-f6678fca-e5ac-42dd-a2aa-4d224f18ee6e) Jun 30 10:00:24.383101 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:00:24.383101 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:00:24.383101 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:00:24.384571 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:00:24.384571 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 30 10:00:24.384571 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 30 10:00:24.384571 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 10:00:24.384571 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 10:00:24.384571 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 10:00:24.384571 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 10:00:24.384571 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 10:00:24.384571 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 10:00:24.384571 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 10:00:24.384571 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 10:00:24.384571 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 10:00:24.384571 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 10:00:24.384571 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 10:00:24.384571 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 10:00:24.384571 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 10:00:24.384571 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 10:00:24.384571 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 10:00:24.384571 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 10:00:24.388064 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 10:00:24.388064 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 10:00:24.388064 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 10:00:24.388064 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 10:00:24.388064 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2068132945 could not be found. Jun 30 10:00:24.388064 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:00:24.388064 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:00:24.388064 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:00:24.388064 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:00:24.388064 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:00:24.388064 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:00:24.388064 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:00:24.388064 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:00:24.388064 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 10:00:24.388064 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 10:00:24.388064 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:00:24.388064 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:00:24.388064 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 30 10:00:24.388064 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:00:24.388064 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2068132945 could not be found. Jun 30 10:00:24.390435 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:00:24.390435 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:00:24.390435 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:00:24.390435 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:00:24.390435 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:00:24.390435 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:00:24.390435 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:00:24.390435 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:00:24.390435 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2068132945 could not be found. Jun 30 10:00:24.390435 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:00:24.390435 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-5bf601e9-8c58-4131-b273-f17067edd451 tempest-VolumesNegativeTest-138105837 tempest-VolumesNegativeTest-138105837-project] Returning 404 to user: Volume tempest-invalid-2068132945 could not be found. {{(pid=117847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:00:24.390435 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-5bf601e9-8c58-4131-b273-f17067edd451 tempest-VolumesNegativeTest-138105837 tempest-VolumesNegativeTest-138105837-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2068132945" status: 404 len: 99 microversion: 2.1 time: 1.222665 Jun 30 10:00:24.390435 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 4/4] 10.222.0.16 () {58 vars in 1217 bytes} [Thu Jun 30 10:00:23 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2068132945 => generated 99 bytes in 1224 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 30 10:00:24.406166 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-318f1ddf-8fdc-4d71-990a-a95e6ae3729b tempest-VolumesNegativeTest-138105837 tempest-VolumesNegativeTest-138105837-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.017570 Jun 30 10:00:24.410622 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 5/5] 10.222.0.16 () {58 vars in 1139 bytes} [Thu Jun 30 10:00:24 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 30 10:00:24.424316 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-17880084-209f-4230-b5bc-9a1a1dd071f9 tempest-VolumesNegativeTest-138105837 tempest-VolumesNegativeTest-138105837-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010221 Jun 30 10:00:24.428830 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 6/6] 10.222.0.16 () {58 vars in 1136 bytes} [Thu Jun 30 10:00:24 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 30 10:00:24.434002 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-61df72c6-5e38-4988-be5b-c2bfa59f05ce tempest-VolumesNegativeTest-138105837 tempest-VolumesNegativeTest-138105837-project] Calling method '.version_select at 0x7fc2221bf790>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:00:24.595929 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.wsgi [None req-61df72c6-5e38-4988-be5b-c2bfa59f05ce tempest-VolumesNegativeTest-138105837 tempest-VolumesNegativeTest-138105837-project] HTTP exception thrown: Volume e6ae1442-e42e-46d8-9ce0-9b50150f1614 could not be found. Jun 30 10:00:24.599060 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-61df72c6-5e38-4988-be5b-c2bfa59f05ce tempest-VolumesNegativeTest-138105837 tempest-VolumesNegativeTest-138105837-project] Request method failure captured: Jun 30 10:00:24.599060 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: request: DELETE /compute/v2.1/os-volumes/e6ae1442-e42e-46d8-9ce0-9b50150f1614 HTTP/1.1 Jun 30 10:00:24.599060 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept: application/json Jun 30 10:00:24.599060 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept-Encoding: identity Jun 30 10:00:24.599060 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Connection: close Jun 30 10:00:24.599060 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Length: 0 Jun 30 10:00:24.599060 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Type: application/json Jun 30 10:00:24.599060 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Host: 10.222.0.16 Jun 30 10:00:24.599060 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Openstack-System-Scope: None Jun 30 10:00:24.599060 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: User-Agent: python-urllib3/1.26.9 Jun 30 10:00:24.599060 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Auth-Token: gAAAAABivXQ1yHJT6-3bd5FzTOFnLcuadZgpscdT_BbCugE60Su193pVNerSJP9UuMvX43HSB8Rr2zjqD9gtFY16fUzMQppU2r3RnpT9mAEZGjdC6iOoIyHyaeP-LmzESUlQwwlQUJxsok8_GvCWYnAfih8z4xBj2PVY8_1eJbBznjb2GelFXlI Jun 30 10:00:24.599060 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Id: None Jun 30 10:00:24.599060 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Name: None Jun 30 10:00:24.599060 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Identity-Status: Confirmed Jun 30 10:00:24.599060 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Is-Admin-Project: True Jun 30 10:00:24.599060 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Id: default Jun 30 10:00:24.599060 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Name: Default Jun 30 10:00:24.599060 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Id: f00f2c2d2dea47e4b868ba84f0dbf5ea Jun 30 10:00:24.599060 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Name: tempest-VolumesNegativeTest-138105837 Jun 30 10:00:24.599060 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Role: reader,member Jun 30 10:00:24.599060 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Roles: reader,member Jun 30 10:00:24.600462 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f00f2c2d2dea47e4b868ba84f0dbf5ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f00f2c2d2dea47e4b868ba84f0dbf5ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f00f2c2d2dea47e4b868ba84f0dbf5ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f00f2c2d2dea47e4b868ba84f0dbf5ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:00:24.600462 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant: tempest-VolumesNegativeTest-138105837 Jun 30 10:00:24.600462 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Id: f00f2c2d2dea47e4b868ba84f0dbf5ea Jun 30 10:00:24.600462 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Name: tempest-VolumesNegativeTest-138105837 Jun 30 10:00:24.600462 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User: tempest-VolumesNegativeTest-138105837-project Jun 30 10:00:24.600462 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Id: default Jun 30 10:00:24.600462 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Name: Default Jun 30 10:00:24.600462 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Id: c8b9ea99092844d59797bbae13a6d362 Jun 30 10:00:24.600462 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Name: tempest-VolumesNegativeTest-138105837-project Jun 30 10:00:24.600462 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: method: Jun 30 10:00:24.600462 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: exception: Volume e6ae1442-e42e-46d8-9ce0-9b50150f1614 could not be found. Jun 30 10:00:24.600462 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: action_args: {'id': 'e6ae1442-e42e-46d8-9ce0-9b50150f1614'} Jun 30 10:00:24.600462 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:00:24.601271 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:00:24.601271 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 10:00:24.601271 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 10:00:24.601271 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 10:00:24.601271 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 10:00:24.601271 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 10:00:24.601271 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 10:00:24.601271 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 10:00:24.601271 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 10:00:24.601271 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 10:00:24.601271 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 10:00:24.601271 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 10:00:24.601271 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 10:00:24.601271 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 10:00:24.601271 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 10:00:24.601271 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e6ae1442-e42e-46d8-9ce0-9b50150f1614 could not be found. (HTTP 404) (Request-ID: req-750414bd-36b1-4d3d-bff9-410284a9b7ea) Jun 30 10:00:24.601271 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:00:24.601271 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:00:24.601271 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:00:24.602446 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:00:24.602446 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 30 10:00:24.602446 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 30 10:00:24.602446 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 10:00:24.602446 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 10:00:24.602446 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 10:00:24.602446 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 10:00:24.602446 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 10:00:24.602446 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 10:00:24.602446 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 10:00:24.602446 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 10:00:24.602446 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 10:00:24.602446 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 10:00:24.602446 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 10:00:24.602446 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 10:00:24.602446 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 10:00:24.602446 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 10:00:24.602446 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 10:00:24.602446 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 10:00:24.606473 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 10:00:24.606473 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 10:00:24.606473 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 10:00:24.606473 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 10:00:24.606473 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e6ae1442-e42e-46d8-9ce0-9b50150f1614 could not be found. Jun 30 10:00:24.606473 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:00:24.606473 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:00:24.606473 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:00:24.606473 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:00:24.606473 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:00:24.606473 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:00:24.606473 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:00:24.606473 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:00:24.606473 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 10:00:24.606473 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 10:00:24.606473 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:00:24.606473 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:00:24.606473 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 30 10:00:24.606473 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:00:24.608999 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e6ae1442-e42e-46d8-9ce0-9b50150f1614 could not be found. Jun 30 10:00:24.608999 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:00:24.608999 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:00:24.608999 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:00:24.608999 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:00:24.608999 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:00:24.608999 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:00:24.608999 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:00:24.608999 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:00:24.608999 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e6ae1442-e42e-46d8-9ce0-9b50150f1614 could not be found. Jun 30 10:00:24.608999 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:00:24.608999 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-61df72c6-5e38-4988-be5b-c2bfa59f05ce tempest-VolumesNegativeTest-138105837 tempest-VolumesNegativeTest-138105837-project] Returning 404 to user: Volume e6ae1442-e42e-46d8-9ce0-9b50150f1614 could not be found. {{(pid=117847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:00:24.608999 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-61df72c6-5e38-4988-be5b-c2bfa59f05ce tempest-VolumesNegativeTest-138105837 tempest-VolumesNegativeTest-138105837-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/e6ae1442-e42e-46d8-9ce0-9b50150f1614" status: 404 len: 109 microversion: 2.1 time: 0.170648 Jun 30 10:00:24.608999 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 7/7] 10.222.0.16 () {58 vars in 1247 bytes} [Thu Jun 30 10:00:24 2022] DELETE /compute/v2.1/os-volumes/e6ae1442-e42e-46d8-9ce0-9b50150f1614 => generated 109 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:00:24.612304 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-25956ebe-3a4b-4b69-a6ea-fce4c29f794b tempest-VolumesNegativeTest-138105837 tempest-VolumesNegativeTest-138105837-project] Calling method '.version_select at 0x7fc2222e9d30>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:00:25.317005 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.wsgi [None req-25956ebe-3a4b-4b69-a6ea-fce4c29f794b tempest-VolumesNegativeTest-138105837 tempest-VolumesNegativeTest-138105837-project] HTTP exception thrown: Volume 3280d24c-48fd-455d-848d-5e9699597709 could not be found. Jun 30 10:00:25.319573 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-25956ebe-3a4b-4b69-a6ea-fce4c29f794b tempest-VolumesNegativeTest-138105837 tempest-VolumesNegativeTest-138105837-project] Request method failure captured: Jun 30 10:00:25.319573 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: request: GET /compute/v2.1/os-volumes/3280d24c-48fd-455d-848d-5e9699597709 HTTP/1.1 Jun 30 10:00:25.319573 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept: application/json Jun 30 10:00:25.319573 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept-Encoding: identity Jun 30 10:00:25.319573 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Connection: close Jun 30 10:00:25.319573 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Length: 0 Jun 30 10:00:25.319573 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Type: application/json Jun 30 10:00:25.319573 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Host: 10.222.0.16 Jun 30 10:00:25.319573 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Openstack-System-Scope: None Jun 30 10:00:25.319573 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: User-Agent: python-urllib3/1.26.9 Jun 30 10:00:25.319573 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Auth-Token: gAAAAABivXQ1yHJT6-3bd5FzTOFnLcuadZgpscdT_BbCugE60Su193pVNerSJP9UuMvX43HSB8Rr2zjqD9gtFY16fUzMQppU2r3RnpT9mAEZGjdC6iOoIyHyaeP-LmzESUlQwwlQUJxsok8_GvCWYnAfih8z4xBj2PVY8_1eJbBznjb2GelFXlI Jun 30 10:00:25.319573 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Id: None Jun 30 10:00:25.319573 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Name: None Jun 30 10:00:25.319573 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Identity-Status: Confirmed Jun 30 10:00:25.319573 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Is-Admin-Project: True Jun 30 10:00:25.319573 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Id: default Jun 30 10:00:25.319573 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Name: Default Jun 30 10:00:25.319573 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Id: f00f2c2d2dea47e4b868ba84f0dbf5ea Jun 30 10:00:25.319573 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Name: tempest-VolumesNegativeTest-138105837 Jun 30 10:00:25.319573 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Role: reader,member Jun 30 10:00:25.319573 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Roles: reader,member Jun 30 10:00:25.321062 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f00f2c2d2dea47e4b868ba84f0dbf5ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f00f2c2d2dea47e4b868ba84f0dbf5ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f00f2c2d2dea47e4b868ba84f0dbf5ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f00f2c2d2dea47e4b868ba84f0dbf5ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:00:25.321062 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant: tempest-VolumesNegativeTest-138105837 Jun 30 10:00:25.321062 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Id: f00f2c2d2dea47e4b868ba84f0dbf5ea Jun 30 10:00:25.321062 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Name: tempest-VolumesNegativeTest-138105837 Jun 30 10:00:25.321062 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User: tempest-VolumesNegativeTest-138105837-project Jun 30 10:00:25.321062 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Id: default Jun 30 10:00:25.321062 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Name: Default Jun 30 10:00:25.321062 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Id: c8b9ea99092844d59797bbae13a6d362 Jun 30 10:00:25.321062 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Name: tempest-VolumesNegativeTest-138105837-project Jun 30 10:00:25.321062 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: method: Jun 30 10:00:25.321062 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: exception: Volume 3280d24c-48fd-455d-848d-5e9699597709 could not be found. Jun 30 10:00:25.321062 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: action_args: {'id': '3280d24c-48fd-455d-848d-5e9699597709'} Jun 30 10:00:25.321062 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:00:25.322262 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:00:25.322262 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 10:00:25.322262 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 10:00:25.322262 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 10:00:25.322262 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 10:00:25.322262 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 10:00:25.322262 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 10:00:25.322262 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 10:00:25.322262 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 10:00:25.322262 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 10:00:25.322262 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 10:00:25.322262 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 10:00:25.322262 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 10:00:25.322262 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 10:00:25.322262 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 10:00:25.322262 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3280d24c-48fd-455d-848d-5e9699597709 could not be found. (HTTP 404) (Request-ID: req-65363cd3-3de6-42a5-b3cf-7150ea3d2c6c) Jun 30 10:00:25.322262 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:00:25.322262 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:00:25.322262 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:00:25.323352 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:00:25.323352 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 30 10:00:25.323352 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 30 10:00:25.323352 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 10:00:25.323352 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 10:00:25.323352 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 10:00:25.323352 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 10:00:25.323352 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 10:00:25.323352 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 10:00:25.323352 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 10:00:25.323352 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 10:00:25.323352 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 10:00:25.323352 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 10:00:25.323352 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 10:00:25.323352 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 10:00:25.323352 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 10:00:25.323352 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 10:00:25.323352 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 10:00:25.323352 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 10:00:25.326958 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 10:00:25.326958 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 10:00:25.326958 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 10:00:25.326958 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 10:00:25.326958 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3280d24c-48fd-455d-848d-5e9699597709 could not be found. Jun 30 10:00:25.326958 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:00:25.326958 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:00:25.326958 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:00:25.326958 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:00:25.326958 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:00:25.326958 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:00:25.326958 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:00:25.326958 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:00:25.326958 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 10:00:25.326958 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 10:00:25.326958 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:00:25.326958 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:00:25.326958 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 30 10:00:25.326958 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:00:25.329171 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3280d24c-48fd-455d-848d-5e9699597709 could not be found. Jun 30 10:00:25.329171 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:00:25.329171 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:00:25.329171 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:00:25.329171 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:00:25.329171 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:00:25.329171 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:00:25.329171 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:00:25.329171 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:00:25.329171 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3280d24c-48fd-455d-848d-5e9699597709 could not be found. Jun 30 10:00:25.329171 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:00:25.329171 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-25956ebe-3a4b-4b69-a6ea-fce4c29f794b tempest-VolumesNegativeTest-138105837 tempest-VolumesNegativeTest-138105837-project] Returning 404 to user: Volume 3280d24c-48fd-455d-848d-5e9699597709 could not be found. {{(pid=117847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:00:25.329171 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-25956ebe-3a4b-4b69-a6ea-fce4c29f794b tempest-VolumesNegativeTest-138105837 tempest-VolumesNegativeTest-138105837-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/3280d24c-48fd-455d-848d-5e9699597709" status: 404 len: 109 microversion: 2.1 time: 0.715259 Jun 30 10:00:25.329171 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 8/8] 10.222.0.16 () {58 vars in 1244 bytes} [Thu Jun 30 10:00:24 2022] GET /compute/v2.1/os-volumes/3280d24c-48fd-455d-848d-5e9699597709 => generated 109 bytes in 717 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:00:25.622727 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-84d34b5c-b9f6-4f8e-9631-e24e72082bad tempest-VolumesGetTestJSON-940258334 tempest-VolumesGetTestJSON-940258334-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.070481 Jun 30 10:00:25.623486 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 1/9] 10.222.0.16 () {60 vars in 1155 bytes} [Thu Jun 30 10:00:21 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4073 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 30 10:00:25.637711 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-a4d8dcd3-4022-4096-8feb-3c5dda545a4b tempest-VolumesGetTestJSON-940258334 tempest-VolumesGetTestJSON-940258334-project] Calling method '.version_select at 0x7fc2221bf310>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:00:25.900117 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-a4d8dcd3-4022-4096-8feb-3c5dda545a4b tempest-VolumesGetTestJSON-940258334 tempest-VolumesGetTestJSON-940258334-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0f759f71-df8d-453c-9d7c-7a45f80a7265" status: 200 len: 352 microversion: 2.1 time: 0.267995 Jun 30 10:00:25.900984 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 9/10] 10.222.0.16 () {58 vars in 1244 bytes} [Thu Jun 30 10:00:25 2022] GET /compute/v2.1/os-volumes/0f759f71-df8d-453c-9d7c-7a45f80a7265 => generated 352 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:00:26.917552 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-7f445332-d632-4a2c-ab90-f2e461ad9455 tempest-VolumesGetTestJSON-940258334 tempest-VolumesGetTestJSON-940258334-project] Calling method '.version_select at 0x7fc22223b280>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:00:27.032949 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-7f445332-d632-4a2c-ab90-f2e461ad9455 tempest-VolumesGetTestJSON-940258334 tempest-VolumesGetTestJSON-940258334-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0f759f71-df8d-453c-9d7c-7a45f80a7265" status: 200 len: 353 microversion: 2.1 time: 0.123818 Jun 30 10:00:27.033972 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 2/11] 10.222.0.16 () {58 vars in 1244 bytes} [Thu Jun 30 10:00:26 2022] GET /compute/v2.1/os-volumes/0f759f71-df8d-453c-9d7c-7a45f80a7265 => generated 353 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:00:27.046180 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-d6fa2190-506b-411f-8ec0-bd675946db50 tempest-VolumesGetTestJSON-940258334 tempest-VolumesGetTestJSON-940258334-project] Calling method '.version_select at 0x7fc2222e9ca0>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:00:27.245826 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-d6fa2190-506b-411f-8ec0-bd675946db50 tempest-VolumesGetTestJSON-940258334 tempest-VolumesGetTestJSON-940258334-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0f759f71-df8d-453c-9d7c-7a45f80a7265" status: 200 len: 353 microversion: 2.1 time: 0.177645 Jun 30 10:00:27.245826 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 10/12] 10.222.0.16 () {58 vars in 1244 bytes} [Thu Jun 30 10:00:27 2022] GET /compute/v2.1/os-volumes/0f759f71-df8d-453c-9d7c-7a45f80a7265 => generated 353 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:00:27.246199 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-7db664f1-a087-4f3c-ad94-f2e4cb687cb5 tempest-VolumesGetTestJSON-940258334 tempest-VolumesGetTestJSON-940258334-project] Calling method '.version_select at 0x7fc22223b550>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:00:27.499174 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-7db664f1-a087-4f3c-ad94-f2e4cb687cb5 tempest-VolumesGetTestJSON-940258334 tempest-VolumesGetTestJSON-940258334-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/0f759f71-df8d-453c-9d7c-7a45f80a7265" status: 202 len: 0 microversion: 2.1 time: 0.267385 Jun 30 10:00:27.503782 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 3/13] 10.222.0.16 () {58 vars in 1247 bytes} [Thu Jun 30 10:00:27 2022] DELETE /compute/v2.1/os-volumes/0f759f71-df8d-453c-9d7c-7a45f80a7265 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:00:27.509644 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-92f8f235-8ba3-4e39-91cd-e48edf718637 tempest-VolumesGetTestJSON-940258334 tempest-VolumesGetTestJSON-940258334-project] Calling method '.version_select at 0x7fc2221bf670>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:00:27.737342 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-92f8f235-8ba3-4e39-91cd-e48edf718637 tempest-VolumesGetTestJSON-940258334 tempest-VolumesGetTestJSON-940258334-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0f759f71-df8d-453c-9d7c-7a45f80a7265" status: 200 len: 352 microversion: 2.1 time: 0.232248 Jun 30 10:00:27.738233 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 11/14] 10.222.0.16 () {58 vars in 1244 bytes} [Thu Jun 30 10:00:27 2022] GET /compute/v2.1/os-volumes/0f759f71-df8d-453c-9d7c-7a45f80a7265 => generated 352 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:00:28.751382 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-0e29febf-31e1-4eb0-9c19-168698c90268 tempest-VolumesGetTestJSON-940258334 tempest-VolumesGetTestJSON-940258334-project] Calling method '.version_select at 0x7fc22223ba60>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:00:28.811270 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-0e29febf-31e1-4eb0-9c19-168698c90268 tempest-VolumesGetTestJSON-940258334 tempest-VolumesGetTestJSON-940258334-project] HTTP exception thrown: Volume 0f759f71-df8d-453c-9d7c-7a45f80a7265 could not be found. Jun 30 10:00:28.816133 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-0e29febf-31e1-4eb0-9c19-168698c90268 tempest-VolumesGetTestJSON-940258334 tempest-VolumesGetTestJSON-940258334-project] Request method failure captured: Jun 30 10:00:28.816133 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: request: GET /compute/v2.1/os-volumes/0f759f71-df8d-453c-9d7c-7a45f80a7265 HTTP/1.1 Jun 30 10:00:28.816133 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept: application/json Jun 30 10:00:28.816133 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jun 30 10:00:28.816133 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Connection: close Jun 30 10:00:28.816133 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jun 30 10:00:28.816133 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jun 30 10:00:28.816133 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Host: 10.222.0.16 Jun 30 10:00:28.816133 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jun 30 10:00:28.816133 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jun 30 10:00:28.816133 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABivXQ1vRv0AewSQy9V7KfMyySSa5GE4E52oGPs3UTT54lFdPYmLUxbfYnXBS34QoHxWkJ76rsMecAYuoQjj9pv1nhEz08h_KVT-iT50JCu843htr8dkP40UBvxQMU6rkcki56SmIkYy8XfVsTSs6OhQENZVycNY75-_Q43eWsDJ0NBiXw Jun 30 10:00:28.816133 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jun 30 10:00:28.816133 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jun 30 10:00:28.816133 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jun 30 10:00:28.816133 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jun 30 10:00:28.816133 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jun 30 10:00:28.816133 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jun 30 10:00:28.816133 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Id: 6451d4335ebf46bc95875604279e780e Jun 30 10:00:28.816133 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-VolumesGetTestJSON-940258334 Jun 30 10:00:28.816133 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Role: reader,member Jun 30 10:00:28.816133 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Roles: reader,member Jun 30 10:00:28.817346 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6451d4335ebf46bc95875604279e780e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6451d4335ebf46bc95875604279e780e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6451d4335ebf46bc95875604279e780e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6451d4335ebf46bc95875604279e780e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:00:28.817346 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-VolumesGetTestJSON-940258334 Jun 30 10:00:28.817346 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 6451d4335ebf46bc95875604279e780e Jun 30 10:00:28.817346 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-VolumesGetTestJSON-940258334 Jun 30 10:00:28.817346 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User: tempest-VolumesGetTestJSON-940258334-project Jun 30 10:00:28.817346 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jun 30 10:00:28.817346 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jun 30 10:00:28.817346 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Id: 20e3f8325dd24d05a1ce4f083f8afd9b Jun 30 10:00:28.817346 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-VolumesGetTestJSON-940258334-project Jun 30 10:00:28.817346 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: method: Jun 30 10:00:28.817346 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: exception: Volume 0f759f71-df8d-453c-9d7c-7a45f80a7265 could not be found. Jun 30 10:00:28.817346 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: action_args: {'id': '0f759f71-df8d-453c-9d7c-7a45f80a7265'} Jun 30 10:00:28.817346 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:00:28.818030 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:00:28.818030 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 10:00:28.818030 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 10:00:28.818030 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 10:00:28.818030 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 10:00:28.818030 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 10:00:28.818030 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 10:00:28.818030 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 10:00:28.818030 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 10:00:28.818030 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 10:00:28.818030 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 10:00:28.818030 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 10:00:28.818030 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 10:00:28.818030 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 10:00:28.818030 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 10:00:28.818030 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0f759f71-df8d-453c-9d7c-7a45f80a7265 could not be found. (HTTP 404) (Request-ID: req-69b99834-64f8-41a2-8fad-47c9ee0e112a) Jun 30 10:00:28.818030 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:00:28.818030 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:00:28.818030 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:00:28.818965 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:00:28.818965 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 30 10:00:28.818965 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 30 10:00:28.818965 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 10:00:28.818965 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 10:00:28.818965 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 10:00:28.818965 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 10:00:28.818965 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 10:00:28.818965 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 10:00:28.818965 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 10:00:28.818965 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 10:00:28.818965 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 10:00:28.818965 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 10:00:28.818965 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 10:00:28.818965 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 10:00:28.818965 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 10:00:28.818965 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 10:00:28.818965 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 10:00:28.818965 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 10:00:28.820705 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 10:00:28.820705 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 10:00:28.820705 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 10:00:28.820705 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 10:00:28.820705 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0f759f71-df8d-453c-9d7c-7a45f80a7265 could not be found. Jun 30 10:00:28.820705 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:00:28.820705 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:00:28.820705 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:00:28.820705 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:00:28.820705 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:00:28.820705 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:00:28.820705 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:00:28.820705 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:00:28.820705 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 10:00:28.820705 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 10:00:28.820705 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:00:28.820705 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:00:28.820705 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 30 10:00:28.820705 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:00:28.821594 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0f759f71-df8d-453c-9d7c-7a45f80a7265 could not be found. Jun 30 10:00:28.821594 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:00:28.821594 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:00:28.821594 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:00:28.821594 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:00:28.821594 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:00:28.821594 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:00:28.821594 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:00:28.821594 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:00:28.821594 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0f759f71-df8d-453c-9d7c-7a45f80a7265 could not be found. Jun 30 10:00:28.821594 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:00:28.821594 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-0e29febf-31e1-4eb0-9c19-168698c90268 tempest-VolumesGetTestJSON-940258334 tempest-VolumesGetTestJSON-940258334-project] Returning 404 to user: Volume 0f759f71-df8d-453c-9d7c-7a45f80a7265 could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:00:28.821594 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-0e29febf-31e1-4eb0-9c19-168698c90268 tempest-VolumesGetTestJSON-940258334 tempest-VolumesGetTestJSON-940258334-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0f759f71-df8d-453c-9d7c-7a45f80a7265" status: 404 len: 109 microversion: 2.1 time: 0.071146 Jun 30 10:00:28.821594 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 4/15] 10.222.0.16 () {58 vars in 1244 bytes} [Thu Jun 30 10:00:28 2022] GET /compute/v2.1/os-volumes/0f759f71-df8d-453c-9d7c-7a45f80a7265 => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:00:31.877582 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-518b9456-3a5e-44c5-a848-da75d8bca1bf tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1926240364", "imageRef": "c9dccba6-70d7-4aa8-9b8f-9c88ef1af443", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:00:32.015354 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.network.neutron [None req-518b9456-3a5e-44c5-a848-da75d8bca1bf tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] validate_networks() for [('d5ea0eb7-1b8b-4933-8808-966ab8cd99e6', None, None, None, None, None)] {{(pid=117847) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 10:00:33.703284 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-518b9456-3a5e-44c5-a848-da75d8bca1bf tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Flavor limits 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 10:00:33.703930 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-518b9456-3a5e-44c5-a848-da75d8bca1bf tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Image limits 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 10:00:33.704206 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-518b9456-3a5e-44c5-a848-da75d8bca1bf tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Flavor pref 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 10:00:33.704613 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-518b9456-3a5e-44c5-a848-da75d8bca1bf tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Image pref 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 10:00:33.705029 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-518b9456-3a5e-44c5-a848-da75d8bca1bf tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 10:00:33.735963 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-518b9456-3a5e-44c5-a848-da75d8bca1bf tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:33.736414 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-518b9456-3a5e-44c5-a848-da75d8bca1bf tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:33.737209 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-518b9456-3a5e-44c5-a848-da75d8bca1bf tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:33.737639 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-518b9456-3a5e-44c5-a848-da75d8bca1bf tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:33.823806 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.quota [None req-518b9456-3a5e-44c5-a848-da75d8bca1bf tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Getting quotas for project 0e8bc4e999ce4f1e9f52b456bcdd88d3. Resources: {'ram', 'instances', 'cores'} {{(pid=117847) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:00:33.833441 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.quota [None req-518b9456-3a5e-44c5-a848-da75d8bca1bf tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Getting quotas for user a179e34636ed4970be4f0790115f9d8f and project 0e8bc4e999ce4f1e9f52b456bcdd88d3. Resources: {'ram', 'instances', 'cores'} {{(pid=117847) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:00:33.877849 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-518b9456-3a5e-44c5-a848-da75d8bca1bf tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Going to run 1 instances... {{(pid=117847) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 10:00:33.883579 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-518b9456-3a5e-44c5-a848-da75d8bca1bf tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9dccba6-70d7-4aa8-9b8f-9c88ef1af443',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117847) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 10:00:34.031234 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-518b9456-3a5e-44c5-a848-da75d8bca1bf tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.329461 Jun 30 10:00:34.032220 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 12/16] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jun 30 10:00:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 2331 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 10:00:34.043026 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-93496233-5453-485f-a837-30bb56f819a7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:00:34.044254 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-93496233-5453-485f-a837-30bb56f819a7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:00:34.318753 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-93496233-5453-485f-a837-30bb56f819a7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:00:34.356403 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-93496233-5453-485f-a837-30bb56f819a7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 200 len: 1222 microversion: 2.1 time: 0.317491 Jun 30 10:00:34.356994 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 5/17] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:00:34 2022] GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 1222 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:00:34.606749 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-2744c25b-5a6d-48e7-8477-c16ce7e509d4 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1680051307", "imageRef": "c9dccba6-70d7-4aa8-9b8f-9c88ef1af443", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:00:34.832659 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.network.neutron [None req-2744c25b-5a6d-48e7-8477-c16ce7e509d4 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] validate_networks() for [('d5ea0eb7-1b8b-4933-8808-966ab8cd99e6', None, None, None, None, None)] {{(pid=117847) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 10:00:37.038275 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-2744c25b-5a6d-48e7-8477-c16ce7e509d4 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Flavor limits 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 10:00:37.038968 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-2744c25b-5a6d-48e7-8477-c16ce7e509d4 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Image limits 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 10:00:37.039156 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-2744c25b-5a6d-48e7-8477-c16ce7e509d4 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Flavor pref 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 10:00:37.039563 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-2744c25b-5a6d-48e7-8477-c16ce7e509d4 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Image pref 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 10:00:37.040000 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-2744c25b-5a6d-48e7-8477-c16ce7e509d4 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 10:00:37.086359 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2744c25b-5a6d-48e7-8477-c16ce7e509d4 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:37.086819 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2744c25b-5a6d-48e7-8477-c16ce7e509d4 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:37.095463 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2744c25b-5a6d-48e7-8477-c16ce7e509d4 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:37.095998 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2744c25b-5a6d-48e7-8477-c16ce7e509d4 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:37.196868 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.quota [None req-2744c25b-5a6d-48e7-8477-c16ce7e509d4 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Getting quotas for project 0e8bc4e999ce4f1e9f52b456bcdd88d3. Resources: {'ram', 'instances', 'cores'} {{(pid=117847) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:00:37.226506 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.quota [None req-2744c25b-5a6d-48e7-8477-c16ce7e509d4 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Getting quotas for user a179e34636ed4970be4f0790115f9d8f and project 0e8bc4e999ce4f1e9f52b456bcdd88d3. Resources: {'ram', 'instances', 'cores'} {{(pid=117847) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:00:37.305744 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-2744c25b-5a6d-48e7-8477-c16ce7e509d4 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Going to run 1 instances... {{(pid=117847) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 10:00:37.317863 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-2744c25b-5a6d-48e7-8477-c16ce7e509d4 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9dccba6-70d7-4aa8-9b8f-9c88ef1af443',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117847) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 10:00:37.502108 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-2744c25b-5a6d-48e7-8477-c16ce7e509d4 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.901364 Jun 30 10:00:37.508102 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 13/18] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jun 30 10:00:34 2022] POST /compute/v2.1/servers => generated 383 bytes in 2907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 30 10:00:37.515825 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-5164e92d-7818-4708-9b99-6c46e2ac139c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:00:37.517290 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-5164e92d-7818-4708-9b99-6c46e2ac139c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:00:37.770494 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-5164e92d-7818-4708-9b99-6c46e2ac139c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:00:37.784510 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-5164e92d-7818-4708-9b99-6c46e2ac139c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1222 microversion: 2.1 time: 0.273891 Jun 30 10:00:37.785622 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 6/19] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:00:37 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1222 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:00:38.803724 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-5e186f0a-640c-4bf8-88c7-0219d082d1f6 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:00:38.804465 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-5e186f0a-640c-4bf8-88c7-0219d082d1f6 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:00:39.114659 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-5e186f0a-640c-4bf8-88c7-0219d082d1f6 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:00:39.158705 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-5e186f0a-640c-4bf8-88c7-0219d082d1f6 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1222 microversion: 2.1 time: 0.358146 Jun 30 10:00:39.161452 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 14/20] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:00:38 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1222 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:00:40.178980 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-ae18dc5d-b06f-4cda-8354-fbd5fa00a39f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:00:40.180211 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-ae18dc5d-b06f-4cda-8354-fbd5fa00a39f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:00:40.196238 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ae18dc5d-b06f-4cda-8354-fbd5fa00a39f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:40.206373 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ae18dc5d-b06f-4cda-8354-fbd5fa00a39f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:40.208370 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ae18dc5d-b06f-4cda-8354-fbd5fa00a39f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:40.211293 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ae18dc5d-b06f-4cda-8354-fbd5fa00a39f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:40.388469 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e654aff3-fa02-4946-ad50-d72f4f92e38e tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-394601256", "imageRef": "c9dccba6-70d7-4aa8-9b8f-9c88ef1af443", "flavorRef": "452", "networks": [{"uuid": "c8cd84f7-a4cb-49c7-89c2-c877c64d5c3e"}]}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:00:40.665865 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.network.neutron [None req-e654aff3-fa02-4946-ad50-d72f4f92e38e tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] validate_networks() for [('c8cd84f7-a4cb-49c7-89c2-c877c64d5c3e', None, None, None, None, None)] {{(pid=117846) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 10:00:40.841590 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-ae18dc5d-b06f-4cda-8354-fbd5fa00a39f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:00:40.915962 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-ae18dc5d-b06f-4cda-8354-fbd5fa00a39f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1280 microversion: 2.1 time: 0.739677 Jun 30 10:00:40.926460 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 15/21] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:00:40 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1280 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:00:41.938339 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-0f7df537-6c0d-4a4a-b544-23fce9acc2a0 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:00:41.940345 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-0f7df537-6c0d-4a4a-b544-23fce9acc2a0 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:00:41.962946 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-0f7df537-6c0d-4a4a-b544-23fce9acc2a0 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:41.967012 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-0f7df537-6c0d-4a4a-b544-23fce9acc2a0 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:41.969844 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-0f7df537-6c0d-4a4a-b544-23fce9acc2a0 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:41.985862 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-0f7df537-6c0d-4a4a-b544-23fce9acc2a0 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:42.369682 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-0f7df537-6c0d-4a4a-b544-23fce9acc2a0 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:00:42.379558 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-0f7df537-6c0d-4a4a-b544-23fce9acc2a0 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1280 microversion: 2.1 time: 0.449007 Jun 30 10:00:42.394710 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 16/22] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:00:41 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1280 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:00:43.346666 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-a93e401a-ed46-49a1-971d-fb77585be509 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Action: 'create', calling method: .version_select at 0x7fc220fb98b0>, body: {"keypair": {"name": "tempest-keypair-286661884", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVB0VPtDSxLS1DR6CHBe6Bjt7jjCQd5GHPq7y3AvotXUIPN5gHUYDU/+8uhylFukDRUlsZFr4rFrD6yYaoDhhNo1UHH87DWOr/w1sVOpq8IV2aN+EbbsKEHIL37evF+Ww=="}} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:00:43.425361 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.quota [None req-a93e401a-ed46-49a1-971d-fb77585be509 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Getting quotas for project 2e55dd4580184f158efedbad5dc6e8fb. Resources: {'key_pairs'} {{(pid=117847) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:00:43.435570 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.quota [None req-a93e401a-ed46-49a1-971d-fb77585be509 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Getting quotas for user 4e9ad2c4909c49a6b3df8ece333e70b5 and project 2e55dd4580184f158efedbad5dc6e8fb. Resources: {'key_pairs'} {{(pid=117847) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:00:43.559523 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-a93e401a-ed46-49a1-971d-fb77585be509 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.935596 Jun 30 10:00:43.568632 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 17/23] 10.222.0.16 () {60 vars in 1158 bytes} [Thu Jun 30 10:00:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:00:43.582733 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-0ddfcfa9-0266-4637-9c88-c2eee0dd6c45 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:00:43.591769 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-0ddfcfa9-0266-4637-9c88-c2eee0dd6c45 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:00:43.606220 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-0ddfcfa9-0266-4637-9c88-c2eee0dd6c45 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:43.608175 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-0ddfcfa9-0266-4637-9c88-c2eee0dd6c45 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:43.610712 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-0ddfcfa9-0266-4637-9c88-c2eee0dd6c45 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:43.613298 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-0ddfcfa9-0266-4637-9c88-c2eee0dd6c45 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:43.865333 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-0ddfcfa9-0266-4637-9c88-c2eee0dd6c45 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:00:43.881902 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-0ddfcfa9-0266-4637-9c88-c2eee0dd6c45 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1280 microversion: 2.1 time: 0.311801 Jun 30 10:00:43.886001 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 18/24] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:00:43 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1280 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:00:44.910173 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-aadb3e85-e05a-4ca8-b370-99f49f5b553d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:00:44.912198 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-aadb3e85-e05a-4ca8-b370-99f49f5b553d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:00:44.940413 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-aadb3e85-e05a-4ca8-b370-99f49f5b553d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:44.949482 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-aadb3e85-e05a-4ca8-b370-99f49f5b553d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:44.951163 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-aadb3e85-e05a-4ca8-b370-99f49f5b553d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:44.972217 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-aadb3e85-e05a-4ca8-b370-99f49f5b553d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:45.887354 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-aadb3e85-e05a-4ca8-b370-99f49f5b553d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:00:45.902203 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-aadb3e85-e05a-4ca8-b370-99f49f5b553d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1280 microversion: 2.1 time: 1.004205 Jun 30 10:00:45.905008 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 19/25] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:00:44 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1280 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:00:46.790726 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-7a5b0f51-1d1f-44b8-88b1-91825f87ece2 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Action: 'create', calling method: .version_select at 0x7fc220f5df70>, body: {"keypair": {"name": "tempest-keypair-1616078124", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+1NsGD9p/gorm5Xp1eB0FDmPlekG7ZRv2YjVby0vqYGEil0SUBsqZUvd0NYz4Ozaag5xgEXYIFjyjTFWUsUNKGEHjMZ1oWhedQO4XzXRE+a26bgd1F2+Hjy79ZzPmNqw=="}} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:00:46.843754 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.quota [None req-7a5b0f51-1d1f-44b8-88b1-91825f87ece2 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Getting quotas for project f43a6e910b6b47c09a859ac798bff5cd. Resources: {'key_pairs'} {{(pid=117847) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:00:46.862562 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.quota [None req-7a5b0f51-1d1f-44b8-88b1-91825f87ece2 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Getting quotas for user 4b1614d524d24ce486741b599268995a and project f43a6e910b6b47c09a859ac798bff5cd. Resources: {'key_pairs'} {{(pid=117847) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:00:46.955029 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-7a5b0f51-1d1f-44b8-88b1-91825f87ece2 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.518033 Jun 30 10:00:46.958724 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 20/26] 10.222.0.16 () {62 vars in 1199 bytes} [Thu Jun 30 10:00:46 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 522 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 30 10:00:46.986134 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-90421335-6cc6-4bcc-9f41-03259e94db0c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:00:46.999761 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-90421335-6cc6-4bcc-9f41-03259e94db0c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:00:47.028508 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-90421335-6cc6-4bcc-9f41-03259e94db0c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:47.031979 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-90421335-6cc6-4bcc-9f41-03259e94db0c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:47.033398 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-90421335-6cc6-4bcc-9f41-03259e94db0c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:47.038565 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-90421335-6cc6-4bcc-9f41-03259e94db0c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:47.158553 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell0:SELECT=4 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:00:47.775512 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=4 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:00:48.608593 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-e654aff3-fa02-4946-ad50-d72f4f92e38e tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Flavor limits 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 10:00:48.610267 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-e654aff3-fa02-4946-ad50-d72f4f92e38e tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Image limits 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 10:00:48.610958 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-e654aff3-fa02-4946-ad50-d72f4f92e38e tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Flavor pref 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 10:00:48.611637 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-e654aff3-fa02-4946-ad50-d72f4f92e38e tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Image pref 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 10:00:48.612127 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-e654aff3-fa02-4946-ad50-d72f4f92e38e tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 10:00:48.660660 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e654aff3-fa02-4946-ad50-d72f4f92e38e tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:48.666731 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e654aff3-fa02-4946-ad50-d72f4f92e38e tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:48.669421 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e654aff3-fa02-4946-ad50-d72f4f92e38e tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:48.670968 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e654aff3-fa02-4946-ad50-d72f4f92e38e tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:48.816041 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-e654aff3-fa02-4946-ad50-d72f4f92e38e tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Getting quotas for project c06b1cb0fcef4cbba01134acdba481be. Resources: {'ram', 'instances', 'cores'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:00:48.841446 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-e654aff3-fa02-4946-ad50-d72f4f92e38e tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Getting quotas for user b7a8708943a94915970a0ff89b9f17e3 and project c06b1cb0fcef4cbba01134acdba481be. Resources: {'ram', 'instances', 'cores'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:00:48.904910 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-e654aff3-fa02-4946-ad50-d72f4f92e38e tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Going to run 1 instances... {{(pid=117846) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 10:00:48.917740 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-e654aff3-fa02-4946-ad50-d72f4f92e38e tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] [instance: b918deb4-fb3e-4cf4-8057-50802bd5af36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9dccba6-70d7-4aa8-9b8f-9c88ef1af443',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117846) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 10:00:49.204915 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-e654aff3-fa02-4946-ad50-d72f4f92e38e tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.673946 Jun 30 10:00:49.209831 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 7/27] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jun 30 10:00:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 9679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 10:00:49.229478 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-b5585f0b-e8ae-44c7-b4cb-f2b192b6ae18 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:00:49.231828 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-b5585f0b-e8ae-44c7-b4cb-f2b192b6ae18 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] [instance: b918deb4-fb3e-4cf4-8057-50802bd5af36] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:00:50.245960 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-90421335-6cc6-4bcc-9f41-03259e94db0c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:00:50.260798 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-90421335-6cc6-4bcc-9f41-03259e94db0c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1322 microversion: 2.1 time: 3.300316 Jun 30 10:00:50.272307 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 21/28] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:00:46 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1322 bytes in 3313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:00:50.359334 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-b5585f0b-e8ae-44c7-b4cb-f2b192b6ae18 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a8708943a94915970a0ff89b9f17e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b1cb0fcef4cbba01134acdba481be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:00:50.379719 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-b5585f0b-e8ae-44c7-b4cb-f2b192b6ae18 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] 10.222.0.16 "GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36" status: 200 len: 1214 microversion: 2.1 time: 1.164277 Jun 30 10:00:50.398801 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 8/29] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:00:49 2022] GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36 => generated 1214 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:00:51.287204 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-9f2e38a9-2c53-439e-a961-4dbe1ba92b82 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:00:51.289114 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-9f2e38a9-2c53-439e-a961-4dbe1ba92b82 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:00:51.310252 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9f2e38a9-2c53-439e-a961-4dbe1ba92b82 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:51.311085 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9f2e38a9-2c53-439e-a961-4dbe1ba92b82 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:51.315792 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9f2e38a9-2c53-439e-a961-4dbe1ba92b82 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:51.316428 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9f2e38a9-2c53-439e-a961-4dbe1ba92b82 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:51.402648 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-66bf0704-196c-468e-a833-e9160027658f tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:00:51.404173 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-66bf0704-196c-468e-a833-e9160027658f tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] [instance: b918deb4-fb3e-4cf4-8057-50802bd5af36] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:00:51.413345 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-66bf0704-196c-468e-a833-e9160027658f tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:51.414253 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-66bf0704-196c-468e-a833-e9160027658f tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:51.417117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-66bf0704-196c-468e-a833-e9160027658f tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:51.418794 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-66bf0704-196c-468e-a833-e9160027658f tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:52.805475 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-66bf0704-196c-468e-a833-e9160027658f tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a8708943a94915970a0ff89b9f17e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b1cb0fcef4cbba01134acdba481be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:00:52.827258 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-66bf0704-196c-468e-a833-e9160027658f tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] 10.222.0.16 "GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36" status: 200 len: 1266 microversion: 2.1 time: 1.428515 Jun 30 10:00:52.827842 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 9/30] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:00:51 2022] GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36 => generated 1266 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:00:53.002382 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-9f2e38a9-2c53-439e-a961-4dbe1ba92b82 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:00:53.035646 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-9f2e38a9-2c53-439e-a961-4dbe1ba92b82 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1322 microversion: 2.1 time: 1.752801 Jun 30 10:00:53.039349 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 22/31] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:00:51 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1322 bytes in 1755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:00:53.048038 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-a909830d-8bd3-4c2a-905c-ced12b42e140 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1968921026", "imageRef": "c9dccba6-70d7-4aa8-9b8f-9c88ef1af443", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "da9749f8-c5ef-4789-90a3-1ad249823d2e"}], "security_groups": [{"name": "tempest-securitygroup--1930237631"}], "key_name": "tempest-keypair-1616078124", "user_data": "}} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:00:53.258158 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-ed5fb1a1-a7e1-4c0e-923c-119cf6ca424a req-cdebc835-039a-4fb4-8ba2-502ecb1e8d20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aa5453f-b4af-4817-a8d4-173f27d1cbd3", "tag": "940a702f-df85-4d3f-ab5f-e3a86923fecb"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:00:53.286898 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-ed5fb1a1-a7e1-4c0e-923c-119cf6ca424a req-cdebc835-039a-4fb4-8ba2-502ecb1e8d20 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:53.286898 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-ed5fb1a1-a7e1-4c0e-923c-119cf6ca424a req-cdebc835-039a-4fb4-8ba2-502ecb1e8d20 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:53.357018 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.network.neutron [None req-a909830d-8bd3-4c2a-905c-ced12b42e140 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] validate_networks() for [('da9749f8-c5ef-4789-90a3-1ad249823d2e', None, None, None, None, None)] {{(pid=117847) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 10:00:53.410232 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-ed5fb1a1-a7e1-4c0e-923c-119cf6ca424a req-cdebc835-039a-4fb4-8ba2-502ecb1e8d20 service nova] Creating event network-changed:940a702f-df85-4d3f-ab5f-e3a86923fecb for instance 3aa5453f-b4af-4817-a8d4-173f27d1cbd3 on hv-cinder-84330 Jun 30 10:00:53.414468 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-ed5fb1a1-a7e1-4c0e-923c-119cf6ca424a req-cdebc835-039a-4fb4-8ba2-502ecb1e8d20 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117846) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 30 10:00:53.415615 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-14b77a6a-9ca1-4286-b1f2-ca4ee1e8893c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:53.416165 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-14b77a6a-9ca1-4286-b1f2-ca4ee1e8893c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:53.428124 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-14b77a6a-9ca1-4286-b1f2-ca4ee1e8893c None None] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:53.428749 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-14b77a6a-9ca1-4286-b1f2-ca4ee1e8893c None None] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:53.465656 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.compute.rpcapi [None req-14b77a6a-9ca1-4286-b1f2-ca4ee1e8893c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 30 10:00:53.468361 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-14b77a6a-9ca1-4286-b1f2-ca4ee1e8893c None None] Releasing lock "compute-rpcapi-router" {{(pid=117846) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 30 10:00:53.519175 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-14b77a6a-9ca1-4286-b1f2-ca4ee1e8893c None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.603760 Jun 30 10:00:53.520151 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 10/32] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:00:53.847352 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-dc9ecc24-b71e-4f03-9f32-c58155c47d0e tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:00:53.849115 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-dc9ecc24-b71e-4f03-9f32-c58155c47d0e tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] [instance: b918deb4-fb3e-4cf4-8057-50802bd5af36] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:00:53.876259 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-dc9ecc24-b71e-4f03-9f32-c58155c47d0e tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:53.877023 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-dc9ecc24-b71e-4f03-9f32-c58155c47d0e tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:53.878516 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-dc9ecc24-b71e-4f03-9f32-c58155c47d0e tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:53.879834 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-dc9ecc24-b71e-4f03-9f32-c58155c47d0e tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:54.230777 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-dc9ecc24-b71e-4f03-9f32-c58155c47d0e tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a8708943a94915970a0ff89b9f17e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b1cb0fcef4cbba01134acdba481be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:00:54.249358 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-dc9ecc24-b71e-4f03-9f32-c58155c47d0e tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] 10.222.0.16 "GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36" status: 200 len: 1272 microversion: 2.1 time: 0.408236 Jun 30 10:00:54.260310 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 11/33] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:00:53 2022] GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36 => generated 1272 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:00:54.260310 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-d865fdbf-b473-4398-a5d9-1b50a538534e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:00:54.260310 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-d865fdbf-b473-4398-a5d9-1b50a538534e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:00:54.275299 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d865fdbf-b473-4398-a5d9-1b50a538534e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:54.275299 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d865fdbf-b473-4398-a5d9-1b50a538534e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:54.275952 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d865fdbf-b473-4398-a5d9-1b50a538534e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:54.276384 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d865fdbf-b473-4398-a5d9-1b50a538534e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:54.858034 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-a909830d-8bd3-4c2a-905c-ced12b42e140 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Flavor limits 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 10:00:54.858757 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-a909830d-8bd3-4c2a-905c-ced12b42e140 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Image limits 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 10:00:54.859570 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-a909830d-8bd3-4c2a-905c-ced12b42e140 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Flavor pref 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 10:00:54.861620 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-a909830d-8bd3-4c2a-905c-ced12b42e140 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Image pref 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 10:00:54.862794 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-a909830d-8bd3-4c2a-905c-ced12b42e140 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 10:00:54.922581 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a909830d-8bd3-4c2a-905c-ced12b42e140 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:54.928776 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a909830d-8bd3-4c2a-905c-ced12b42e140 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:54.936191 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a909830d-8bd3-4c2a-905c-ced12b42e140 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:54.937055 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a909830d-8bd3-4c2a-905c-ced12b42e140 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:54.968931 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-d865fdbf-b473-4398-a5d9-1b50a538534e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:00:54.979193 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-d865fdbf-b473-4398-a5d9-1b50a538534e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1322 microversion: 2.1 time: 0.724757 Jun 30 10:00:54.995426 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 12/34] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:00:54 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1322 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:00:55.010545 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.quota [None req-a909830d-8bd3-4c2a-905c-ced12b42e140 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Getting quotas for project f43a6e910b6b47c09a859ac798bff5cd. Resources: {'ram', 'instances', 'cores'} {{(pid=117847) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:00:55.021721 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.quota [None req-a909830d-8bd3-4c2a-905c-ced12b42e140 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Getting quotas for user 4b1614d524d24ce486741b599268995a and project f43a6e910b6b47c09a859ac798bff5cd. Resources: {'ram', 'instances', 'cores'} {{(pid=117847) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:00:55.079281 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-a909830d-8bd3-4c2a-905c-ced12b42e140 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Going to run 1 instances... {{(pid=117847) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 10:00:55.084762 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-a909830d-8bd3-4c2a-905c-ced12b42e140 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9dccba6-70d7-4aa8-9b8f-9c88ef1af443',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117847) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 10:00:55.232577 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-a909830d-8bd3-4c2a-905c-ced12b42e140 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.187085 Jun 30 10:00:55.235602 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 23/35] 10.222.0.16 () {62 vars in 1187 bytes} [Thu Jun 30 10:00:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 2195 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 30 10:00:55.247380 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-d1df603c-0dac-45e4-82cf-05b5b1da9b7e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:00:55.248492 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-d1df603c-0dac-45e4-82cf-05b5b1da9b7e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:00:55.295906 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-7ae9d811-cc70-4086-9bf5-dce7d1c6dd73 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:00:55.302910 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-7ae9d811-cc70-4086-9bf5-dce7d1c6dd73 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] [instance: b918deb4-fb3e-4cf4-8057-50802bd5af36] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:00:55.348518 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7ae9d811-cc70-4086-9bf5-dce7d1c6dd73 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:55.352253 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7ae9d811-cc70-4086-9bf5-dce7d1c6dd73 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:55.356348 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7ae9d811-cc70-4086-9bf5-dce7d1c6dd73 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:55.362249 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7ae9d811-cc70-4086-9bf5-dce7d1c6dd73 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:55.387363 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-d1df603c-0dac-45e4-82cf-05b5b1da9b7e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:00:55.401415 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-d1df603c-0dac-45e4-82cf-05b5b1da9b7e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:00:55.404850 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-d1df603c-0dac-45e4-82cf-05b5b1da9b7e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:00:55.407014 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-d1df603c-0dac-45e4-82cf-05b5b1da9b7e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1282 microversion: 2.20 time: 0.164899 Jun 30 10:00:55.412075 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 13/36] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:00:55 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1282 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:00:55.565974 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-2307d253-18b5-431a-b21d-da096ddc72c9 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1609421443", "imageRef": "c9dccba6-70d7-4aa8-9b8f-9c88ef1af443", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0141f079-f9f5-43fa-9ae7-09ea5e157c2e"}], "security_groups": [{"name": "tempest-securitygroup--1846870686"}], "key_name": "tempest-keypair-286661884", "user_data": "}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:00:55.608675 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-7ae9d811-cc70-4086-9bf5-dce7d1c6dd73 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a8708943a94915970a0ff89b9f17e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b1cb0fcef4cbba01134acdba481be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:00:55.618780 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-7ae9d811-cc70-4086-9bf5-dce7d1c6dd73 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] 10.222.0.16 "GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36" status: 200 len: 1272 microversion: 2.1 time: 0.346700 Jun 30 10:00:55.620085 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 24/37] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:00:55 2022] GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36 => generated 1272 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:00:55.626726 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [req-13e171df-c461-442b-9437-29b64cecfe6d req-b076522a-a226-4383-9813-2b0dfc9f774a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75c53f4a-19c7-4452-8243-40e32ce8c2b3", "tag": "a18a08f6-983b-4ecd-acd2-550b4a54f767"}]} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:00:55.664858 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-13e171df-c461-442b-9437-29b64cecfe6d req-b076522a-a226-4383-9813-2b0dfc9f774a service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:55.665362 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-13e171df-c461-442b-9437-29b64cecfe6d req-b076522a-a226-4383-9813-2b0dfc9f774a service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:55.699885 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.compute.server_external_events [req-13e171df-c461-442b-9437-29b64cecfe6d req-b076522a-a226-4383-9813-2b0dfc9f774a service nova] Creating event network-changed:a18a08f6-983b-4ecd-acd2-550b4a54f767 for instance 75c53f4a-19c7-4452-8243-40e32ce8c2b3 on hv-cinder-84330 Jun 30 10:00:55.700478 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-13e171df-c461-442b-9437-29b64cecfe6d req-b076522a-a226-4383-9813-2b0dfc9f774a service nova] Acquired lock "compute-rpcapi-router" {{(pid=117847) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 30 10:00:55.701439 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-fd2d3f37-5034-4056-9f14-0f0af587dc75 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:55.702226 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-fd2d3f37-5034-4056-9f14-0f0af587dc75 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:55.703654 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-fd2d3f37-5034-4056-9f14-0f0af587dc75 None None] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:55.704708 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-fd2d3f37-5034-4056-9f14-0f0af587dc75 None None] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:55.761444 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.compute.rpcapi [None req-fd2d3f37-5034-4056-9f14-0f0af587dc75 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 30 10:00:55.762358 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-fd2d3f37-5034-4056-9f14-0f0af587dc75 None None] Releasing lock "compute-rpcapi-router" {{(pid=117847) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 30 10:00:55.811637 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-fd2d3f37-5034-4056-9f14-0f0af587dc75 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189757 Jun 30 10:00:55.812365 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 25/38] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:00:55.885902 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.network.neutron [None req-2307d253-18b5-431a-b21d-da096ddc72c9 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] validate_networks() for [('0141f079-f9f5-43fa-9ae7-09ea5e157c2e', None, None, None, None, None)] {{(pid=117846) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 10:00:56.003356 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-3f49fdad-89a2-4878-b00d-e2107f55a1ed tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:00:56.004793 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-3f49fdad-89a2-4878-b00d-e2107f55a1ed tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:00:56.039700 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3f49fdad-89a2-4878-b00d-e2107f55a1ed tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:56.042406 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3f49fdad-89a2-4878-b00d-e2107f55a1ed tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:56.049728 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3f49fdad-89a2-4878-b00d-e2107f55a1ed tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:56.052568 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3f49fdad-89a2-4878-b00d-e2107f55a1ed tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:56.379695 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-3f49fdad-89a2-4878-b00d-e2107f55a1ed tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:00:56.388110 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-3f49fdad-89a2-4878-b00d-e2107f55a1ed tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1322 microversion: 2.1 time: 0.389795 Jun 30 10:00:56.388897 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 26/39] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:00:55 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1322 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:00:56.430811 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-7dcd105b-9e85-4ab5-9fa1-7c38bad494b6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:00:56.431726 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-7dcd105b-9e85-4ab5-9fa1-7c38bad494b6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:00:56.438788 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7dcd105b-9e85-4ab5-9fa1-7c38bad494b6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:56.439461 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7dcd105b-9e85-4ab5-9fa1-7c38bad494b6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:56.440573 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7dcd105b-9e85-4ab5-9fa1-7c38bad494b6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:56.441286 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7dcd105b-9e85-4ab5-9fa1-7c38bad494b6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:56.496237 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-2307d253-18b5-431a-b21d-da096ddc72c9 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Flavor limits 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 10:00:56.497420 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-2307d253-18b5-431a-b21d-da096ddc72c9 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Image limits 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 10:00:56.498167 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-2307d253-18b5-431a-b21d-da096ddc72c9 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Flavor pref 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 10:00:56.498947 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-2307d253-18b5-431a-b21d-da096ddc72c9 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Image pref 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 10:00:56.499366 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-2307d253-18b5-431a-b21d-da096ddc72c9 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 10:00:56.510299 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2307d253-18b5-431a-b21d-da096ddc72c9 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:56.510996 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2307d253-18b5-431a-b21d-da096ddc72c9 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:56.512070 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2307d253-18b5-431a-b21d-da096ddc72c9 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:56.512608 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2307d253-18b5-431a-b21d-da096ddc72c9 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:56.513018 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-7dcd105b-9e85-4ab5-9fa1-7c38bad494b6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:00:56.520872 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-7dcd105b-9e85-4ab5-9fa1-7c38bad494b6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:00:56.522361 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-7dcd105b-9e85-4ab5-9fa1-7c38bad494b6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:00:56.523433 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-7dcd105b-9e85-4ab5-9fa1-7c38bad494b6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1286 microversion: 2.20 time: 0.097301 Jun 30 10:00:56.524162 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 27/40] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:00:56 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1286 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:00:56.537149 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-2307d253-18b5-431a-b21d-da096ddc72c9 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Getting quotas for project 2e55dd4580184f158efedbad5dc6e8fb. Resources: {'ram', 'instances', 'cores'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:00:56.541581 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-2307d253-18b5-431a-b21d-da096ddc72c9 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Getting quotas for user 4e9ad2c4909c49a6b3df8ece333e70b5 and project 2e55dd4580184f158efedbad5dc6e8fb. Resources: {'ram', 'instances', 'cores'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:00:56.552936 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-2307d253-18b5-431a-b21d-da096ddc72c9 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Going to run 1 instances... {{(pid=117846) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 10:00:56.555229 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-2307d253-18b5-431a-b21d-da096ddc72c9 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 18a19a8d-e121-4f9d-8906-574d6ecce160] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9dccba6-70d7-4aa8-9b8f-9c88ef1af443',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117846) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 10:00:56.605654 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-2307d253-18b5-431a-b21d-da096ddc72c9 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.045454 Jun 30 10:00:56.606625 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 14/41] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jun 30 10:00:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 1047 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 10:00:56.616477 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-b38b50b1-ef93-4635-aab6-a52b632a6f9f tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:00:56.617284 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-b38b50b1-ef93-4635-aab6-a52b632a6f9f tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 18a19a8d-e121-4f9d-8906-574d6ecce160] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:00:56.621181 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:00:56.638019 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f4440a58-80d2-4576-9288-73ce6d2a457e tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:00:56.639063 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f4440a58-80d2-4576-9288-73ce6d2a457e tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] [instance: b918deb4-fb3e-4cf4-8057-50802bd5af36] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:00:56.646558 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f4440a58-80d2-4576-9288-73ce6d2a457e tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:56.647724 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f4440a58-80d2-4576-9288-73ce6d2a457e tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:56.649141 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f4440a58-80d2-4576-9288-73ce6d2a457e tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:56.649787 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f4440a58-80d2-4576-9288-73ce6d2a457e tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:56.677353 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-b38b50b1-ef93-4635-aab6-a52b632a6f9f tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:00:56.684310 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-b38b50b1-ef93-4635-aab6-a52b632a6f9f tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160" status: 200 len: 1241 microversion: 2.1 time: 0.071583 Jun 30 10:00:56.685983 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 28/42] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:00:56 2022] GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160 => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:00:56.722986 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f4440a58-80d2-4576-9288-73ce6d2a457e tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a8708943a94915970a0ff89b9f17e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b1cb0fcef4cbba01134acdba481be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:00:56.730967 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f4440a58-80d2-4576-9288-73ce6d2a457e tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] 10.222.0.16 "GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36" status: 200 len: 1272 microversion: 2.1 time: 0.098240 Jun 30 10:00:56.731526 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 15/43] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:00:56 2022] GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36 => generated 1272 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:00:57.404711 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-88bc1982-3ce3-4902-a76b-56d62fb0188a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:00:57.405445 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-88bc1982-3ce3-4902-a76b-56d62fb0188a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:00:57.411377 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-88bc1982-3ce3-4902-a76b-56d62fb0188a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:57.411822 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-88bc1982-3ce3-4902-a76b-56d62fb0188a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:57.412611 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-88bc1982-3ce3-4902-a76b-56d62fb0188a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:57.413041 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-88bc1982-3ce3-4902-a76b-56d62fb0188a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:57.542360 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-56db53aa-fec1-4987-9306-98192f2b1aaa tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:00:57.543447 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-56db53aa-fec1-4987-9306-98192f2b1aaa tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:00:57.551931 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-56db53aa-fec1-4987-9306-98192f2b1aaa tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:57.552377 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-56db53aa-fec1-4987-9306-98192f2b1aaa tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:57.553314 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-56db53aa-fec1-4987-9306-98192f2b1aaa tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:57.553889 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-56db53aa-fec1-4987-9306-98192f2b1aaa tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:57.562025 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-88bc1982-3ce3-4902-a76b-56d62fb0188a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:00:57.576299 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-88bc1982-3ce3-4902-a76b-56d62fb0188a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1322 microversion: 2.1 time: 0.175292 Jun 30 10:00:57.576875 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 29/44] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:00:57 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:00:57.634179 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-56db53aa-fec1-4987-9306-98192f2b1aaa tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:00:57.642837 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-56db53aa-fec1-4987-9306-98192f2b1aaa tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:00:57.644370 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-56db53aa-fec1-4987-9306-98192f2b1aaa tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:00:57.645458 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-56db53aa-fec1-4987-9306-98192f2b1aaa tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1286 microversion: 2.20 time: 0.108036 Jun 30 10:00:57.646019 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 16/45] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:00:57 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1286 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:00:57.702219 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-4ead5eaf-49d6-4735-8214-444fd66844c5 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:00:57.702868 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-4ead5eaf-49d6-4735-8214-444fd66844c5 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 18a19a8d-e121-4f9d-8906-574d6ecce160] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:00:57.710742 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4ead5eaf-49d6-4735-8214-444fd66844c5 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:57.711220 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4ead5eaf-49d6-4735-8214-444fd66844c5 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:57.712170 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4ead5eaf-49d6-4735-8214-444fd66844c5 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:57.712648 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4ead5eaf-49d6-4735-8214-444fd66844c5 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:57.748227 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f3d27cd6-8f59-4937-bc2f-8c1feba64607 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:00:57.748964 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f3d27cd6-8f59-4937-bc2f-8c1feba64607 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] [instance: b918deb4-fb3e-4cf4-8057-50802bd5af36] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:00:57.755464 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f3d27cd6-8f59-4937-bc2f-8c1feba64607 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:57.755910 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f3d27cd6-8f59-4937-bc2f-8c1feba64607 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:57.756687 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f3d27cd6-8f59-4937-bc2f-8c1feba64607 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:57.757100 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f3d27cd6-8f59-4937-bc2f-8c1feba64607 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:57.775094 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-4ead5eaf-49d6-4735-8214-444fd66844c5 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:00:57.782971 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-4ead5eaf-49d6-4735-8214-444fd66844c5 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160" status: 200 len: 1245 microversion: 2.1 time: 0.084546 Jun 30 10:00:57.783765 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 30/46] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:00:57 2022] GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:00:57.819996 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f3d27cd6-8f59-4937-bc2f-8c1feba64607 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a8708943a94915970a0ff89b9f17e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b1cb0fcef4cbba01134acdba481be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:00:57.828545 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f3d27cd6-8f59-4937-bc2f-8c1feba64607 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] 10.222.0.16 "GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36" status: 200 len: 1272 microversion: 2.1 time: 0.084539 Jun 30 10:00:57.829200 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 17/47] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:00:57 2022] GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36 => generated 1272 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:00:58.594026 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-390cdcd7-dad4-403f-ba4e-37fcb8fc9bca tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:00:58.594782 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-390cdcd7-dad4-403f-ba4e-37fcb8fc9bca tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:00:58.601199 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-390cdcd7-dad4-403f-ba4e-37fcb8fc9bca tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:58.601779 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-390cdcd7-dad4-403f-ba4e-37fcb8fc9bca tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:58.602688 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-390cdcd7-dad4-403f-ba4e-37fcb8fc9bca tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:58.603210 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-390cdcd7-dad4-403f-ba4e-37fcb8fc9bca tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:58.664953 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-4b15d582-8eec-460a-a3bb-f82c564a3e5b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:00:58.666120 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-4b15d582-8eec-460a-a3bb-f82c564a3e5b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:00:58.679963 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4b15d582-8eec-460a-a3bb-f82c564a3e5b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:58.681175 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4b15d582-8eec-460a-a3bb-f82c564a3e5b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:58.683016 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4b15d582-8eec-460a-a3bb-f82c564a3e5b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:58.683453 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4b15d582-8eec-460a-a3bb-f82c564a3e5b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:58.752686 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-4b15d582-8eec-460a-a3bb-f82c564a3e5b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:00:58.762529 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-4b15d582-8eec-460a-a3bb-f82c564a3e5b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:00:58.764346 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-4b15d582-8eec-460a-a3bb-f82c564a3e5b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:00:58.765462 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-4b15d582-8eec-460a-a3bb-f82c564a3e5b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1286 microversion: 2.20 time: 0.104743 Jun 30 10:00:58.766005 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 18/48] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:00:58 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1286 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:00:58.800523 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-fbd8d488-25e0-4da9-90ce-4c98f0292d93 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:00:58.801450 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-fbd8d488-25e0-4da9-90ce-4c98f0292d93 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 18a19a8d-e121-4f9d-8906-574d6ecce160] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:00:58.807382 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fbd8d488-25e0-4da9-90ce-4c98f0292d93 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:58.807831 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fbd8d488-25e0-4da9-90ce-4c98f0292d93 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:58.808825 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fbd8d488-25e0-4da9-90ce-4c98f0292d93 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:58.809407 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fbd8d488-25e0-4da9-90ce-4c98f0292d93 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:58.819693 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-390cdcd7-dad4-403f-ba4e-37fcb8fc9bca tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:00:58.833018 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-390cdcd7-dad4-403f-ba4e-37fcb8fc9bca tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1322 microversion: 2.1 time: 0.243695 Jun 30 10:00:58.833808 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 31/49] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:00:58 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:00:58.848342 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-46e098c6-dc6b-42b2-8f00-db64061e772a tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:00:58.849263 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-46e098c6-dc6b-42b2-8f00-db64061e772a tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] [instance: b918deb4-fb3e-4cf4-8057-50802bd5af36] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:00:58.857020 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-46e098c6-dc6b-42b2-8f00-db64061e772a tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:58.857476 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-46e098c6-dc6b-42b2-8f00-db64061e772a tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:58.858255 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-46e098c6-dc6b-42b2-8f00-db64061e772a tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:58.858691 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-46e098c6-dc6b-42b2-8f00-db64061e772a tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:58.889926 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-fbd8d488-25e0-4da9-90ce-4c98f0292d93 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:00:58.898466 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-fbd8d488-25e0-4da9-90ce-4c98f0292d93 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160" status: 200 len: 1245 microversion: 2.1 time: 0.101681 Jun 30 10:00:58.899715 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 19/50] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:00:58 2022] GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160 => generated 1245 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:00:58.943590 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-46e098c6-dc6b-42b2-8f00-db64061e772a tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a8708943a94915970a0ff89b9f17e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b1cb0fcef4cbba01134acdba481be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:00:58.951989 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-46e098c6-dc6b-42b2-8f00-db64061e772a tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] 10.222.0.16 "GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36" status: 200 len: 1272 microversion: 2.1 time: 0.107978 Jun 30 10:00:58.952615 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 32/51] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:00:58 2022] GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36 => generated 1272 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:00:59.786193 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-755aef56-2f05-4002-85ab-4c6279b77919 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:00:59.786735 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-755aef56-2f05-4002-85ab-4c6279b77919 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:00:59.794839 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-755aef56-2f05-4002-85ab-4c6279b77919 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:59.795291 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-755aef56-2f05-4002-85ab-4c6279b77919 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:59.796087 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-755aef56-2f05-4002-85ab-4c6279b77919 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:59.796521 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-755aef56-2f05-4002-85ab-4c6279b77919 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:59.851648 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-dfe832f3-8423-4eda-ba42-4bb6d364c06f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:00:59.852318 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-dfe832f3-8423-4eda-ba42-4bb6d364c06f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:00:59.858724 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-dfe832f3-8423-4eda-ba42-4bb6d364c06f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:59.859160 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-dfe832f3-8423-4eda-ba42-4bb6d364c06f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:59.860159 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-dfe832f3-8423-4eda-ba42-4bb6d364c06f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:59.860583 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-dfe832f3-8423-4eda-ba42-4bb6d364c06f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:59.866026 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-755aef56-2f05-4002-85ab-4c6279b77919 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:00:59.874472 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-755aef56-2f05-4002-85ab-4c6279b77919 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:00:59.876035 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-755aef56-2f05-4002-85ab-4c6279b77919 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:00:59.877163 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-755aef56-2f05-4002-85ab-4c6279b77919 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1286 microversion: 2.20 time: 0.097405 Jun 30 10:00:59.877744 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 20/52] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:00:59 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1286 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:00:59.915580 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-cf9fc6a7-8124-4355-b9b2-50e2297749ec tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:00:59.916344 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-cf9fc6a7-8124-4355-b9b2-50e2297749ec tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 18a19a8d-e121-4f9d-8906-574d6ecce160] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:00:59.922929 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cf9fc6a7-8124-4355-b9b2-50e2297749ec tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:59.923639 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cf9fc6a7-8124-4355-b9b2-50e2297749ec tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:59.924441 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cf9fc6a7-8124-4355-b9b2-50e2297749ec tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:00:59.924876 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cf9fc6a7-8124-4355-b9b2-50e2297749ec tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:00:59.994953 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-cf9fc6a7-8124-4355-b9b2-50e2297749ec tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:00.002883 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-cf9fc6a7-8124-4355-b9b2-50e2297749ec tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160" status: 200 len: 1245 microversion: 2.1 time: 0.091114 Jun 30 10:01:00.003652 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 21/53] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:00:59 2022] GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160 => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:00.008109 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-3f8668ba-c5bb-41e3-a2fb-58b3974debf4 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:00.008898 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-3f8668ba-c5bb-41e3-a2fb-58b3974debf4 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] [instance: b918deb4-fb3e-4cf4-8057-50802bd5af36] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:00.014849 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3f8668ba-c5bb-41e3-a2fb-58b3974debf4 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:00.015313 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3f8668ba-c5bb-41e3-a2fb-58b3974debf4 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:00.016117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3f8668ba-c5bb-41e3-a2fb-58b3974debf4 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:00.016471 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-dfe832f3-8423-4eda-ba42-4bb6d364c06f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:00.016611 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3f8668ba-c5bb-41e3-a2fb-58b3974debf4 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:00.023967 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-dfe832f3-8423-4eda-ba42-4bb6d364c06f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1322 microversion: 2.1 time: 0.176138 Jun 30 10:01:00.024838 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 33/54] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:00:59 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:00.078810 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-3f8668ba-c5bb-41e3-a2fb-58b3974debf4 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a8708943a94915970a0ff89b9f17e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b1cb0fcef4cbba01134acdba481be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:00.086506 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-3f8668ba-c5bb-41e3-a2fb-58b3974debf4 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] 10.222.0.16 "GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36" status: 200 len: 1272 microversion: 2.1 time: 0.081988 Jun 30 10:01:00.087061 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 22/55] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:00 2022] GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36 => generated 1272 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:00.899448 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-8f5ed796-63e8-4972-94a9-5690ac2b0f7e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:00.900482 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-8f5ed796-63e8-4972-94a9-5690ac2b0f7e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:00.907267 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8f5ed796-63e8-4972-94a9-5690ac2b0f7e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:00.907707 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8f5ed796-63e8-4972-94a9-5690ac2b0f7e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:00.908476 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8f5ed796-63e8-4972-94a9-5690ac2b0f7e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:00.908901 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8f5ed796-63e8-4972-94a9-5690ac2b0f7e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:00.981226 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-8f5ed796-63e8-4972-94a9-5690ac2b0f7e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:00.984650 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell1:SELECT=100 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:01:00.989785 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-8f5ed796-63e8-4972-94a9-5690ac2b0f7e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:00.991287 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-8f5ed796-63e8-4972-94a9-5690ac2b0f7e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:00.992408 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-8f5ed796-63e8-4972-94a9-5690ac2b0f7e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1286 microversion: 2.20 time: 0.099452 Jun 30 10:01:00.992949 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 34/56] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:01:00 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1286 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:01:01.020173 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-3bff787c-3017-43ee-a6c7-b2d86bad30a5 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:01.020763 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-3bff787c-3017-43ee-a6c7-b2d86bad30a5 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 18a19a8d-e121-4f9d-8906-574d6ecce160] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:01.027370 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3bff787c-3017-43ee-a6c7-b2d86bad30a5 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:01.027816 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3bff787c-3017-43ee-a6c7-b2d86bad30a5 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:01.028601 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3bff787c-3017-43ee-a6c7-b2d86bad30a5 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:01.029030 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3bff787c-3017-43ee-a6c7-b2d86bad30a5 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:01.040206 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-6dfbb194-bea5-484d-b7d7-5827f9b859ec tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:01.040830 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-6dfbb194-bea5-484d-b7d7-5827f9b859ec tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:01.048661 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-6dfbb194-bea5-484d-b7d7-5827f9b859ec tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:01.049191 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-6dfbb194-bea5-484d-b7d7-5827f9b859ec tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:01.050243 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-6dfbb194-bea5-484d-b7d7-5827f9b859ec tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:01.050843 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-6dfbb194-bea5-484d-b7d7-5827f9b859ec tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:01.098230 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-3bff787c-3017-43ee-a6c7-b2d86bad30a5 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:01.106314 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-3bff787c-3017-43ee-a6c7-b2d86bad30a5 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160" status: 200 len: 1245 microversion: 2.1 time: 0.090194 Jun 30 10:01:01.106905 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 23/57] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:01 2022] GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160 => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:01.121318 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-9255bdb4-39f1-4baf-b426-70964b796052 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:01.121929 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-9255bdb4-39f1-4baf-b426-70964b796052 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] [instance: b918deb4-fb3e-4cf4-8057-50802bd5af36] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:01.128312 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9255bdb4-39f1-4baf-b426-70964b796052 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:01.128756 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9255bdb4-39f1-4baf-b426-70964b796052 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:01.129518 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9255bdb4-39f1-4baf-b426-70964b796052 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:01.129945 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9255bdb4-39f1-4baf-b426-70964b796052 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:01.199325 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-9255bdb4-39f1-4baf-b426-70964b796052 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a8708943a94915970a0ff89b9f17e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b1cb0fcef4cbba01134acdba481be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:01.207290 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-9255bdb4-39f1-4baf-b426-70964b796052 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] 10.222.0.16 "GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36" status: 200 len: 1272 microversion: 2.1 time: 0.090659 Jun 30 10:01:01.208058 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 24/58] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:01 2022] GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36 => generated 1272 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:01.221395 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-6dfbb194-bea5-484d-b7d7-5827f9b859ec tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:01.229508 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-6dfbb194-bea5-484d-b7d7-5827f9b859ec tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1322 microversion: 2.1 time: 0.193426 Jun 30 10:01:01.230068 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 35/59] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:01 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:02.010883 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-17bd1535-167b-4e8a-ac41-9bf25782952f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:02.012100 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-17bd1535-167b-4e8a-ac41-9bf25782952f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:02.023990 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-17bd1535-167b-4e8a-ac41-9bf25782952f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:02.024655 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-17bd1535-167b-4e8a-ac41-9bf25782952f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:02.025542 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-17bd1535-167b-4e8a-ac41-9bf25782952f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:02.026063 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-17bd1535-167b-4e8a-ac41-9bf25782952f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:02.127845 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-f076ebb4-80a6-4b66-ac76-2f5dd293f900 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:02.129326 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-f076ebb4-80a6-4b66-ac76-2f5dd293f900 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 18a19a8d-e121-4f9d-8906-574d6ecce160] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:02.136639 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-f076ebb4-80a6-4b66-ac76-2f5dd293f900 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:02.137429 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-f076ebb4-80a6-4b66-ac76-2f5dd293f900 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:02.138406 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-f076ebb4-80a6-4b66-ac76-2f5dd293f900 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:02.139051 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-f076ebb4-80a6-4b66-ac76-2f5dd293f900 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:02.253774 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-f076ebb4-80a6-4b66-ac76-2f5dd293f900 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:02.266364 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-f076ebb4-80a6-4b66-ac76-2f5dd293f900 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160" status: 200 len: 1301 microversion: 2.1 time: 0.142406 Jun 30 10:01:02.267278 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 36/60] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:02 2022] GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160 => generated 1301 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:02.279978 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-17bd1535-167b-4e8a-ac41-9bf25782952f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:02.285686 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-20341805-c3fe-42a8-bc09-0dece334b567 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:02.286338 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-20341805-c3fe-42a8-bc09-0dece334b567 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] [instance: b918deb4-fb3e-4cf4-8057-50802bd5af36] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:02.296127 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-17bd1535-167b-4e8a-ac41-9bf25782952f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:02.297226 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-20341805-c3fe-42a8-bc09-0dece334b567 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:02.297681 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-20341805-c3fe-42a8-bc09-0dece334b567 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:02.298467 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-20341805-c3fe-42a8-bc09-0dece334b567 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:02.298902 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-20341805-c3fe-42a8-bc09-0dece334b567 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:02.300410 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-17bd1535-167b-4e8a-ac41-9bf25782952f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:02.303628 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-17bd1535-167b-4e8a-ac41-9bf25782952f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1334 microversion: 2.20 time: 0.296994 Jun 30 10:01:02.317767 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 25/61] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:01:02 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1334 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:01:02.325673 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-fbdc4cc6-7849-4cb2-ba9e-3ae691b6a282 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:02.342683 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-fbdc4cc6-7849-4cb2-ba9e-3ae691b6a282 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:02.366748 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fbdc4cc6-7849-4cb2-ba9e-3ae691b6a282 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:02.373666 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fbdc4cc6-7849-4cb2-ba9e-3ae691b6a282 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:02.376322 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fbdc4cc6-7849-4cb2-ba9e-3ae691b6a282 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:02.379976 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fbdc4cc6-7849-4cb2-ba9e-3ae691b6a282 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:02.637199 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-20341805-c3fe-42a8-bc09-0dece334b567 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a8708943a94915970a0ff89b9f17e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b1cb0fcef4cbba01134acdba481be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:02.644965 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-20341805-c3fe-42a8-bc09-0dece334b567 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] 10.222.0.16 "GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36" status: 200 len: 1314 microversion: 2.1 time: 0.375010 Jun 30 10:01:02.646019 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 37/62] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:02 2022] GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36 => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:02.717755 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-fbdc4cc6-7849-4cb2-ba9e-3ae691b6a282 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:02.726481 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-fbdc4cc6-7849-4cb2-ba9e-3ae691b6a282 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1322 microversion: 2.1 time: 0.407639 Jun 30 10:01:02.727092 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 26/63] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:02 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1322 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:03.284242 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-8c64b4de-1479-4ebd-bbb3-12cef5cf812c tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:03.284877 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-8c64b4de-1479-4ebd-bbb3-12cef5cf812c tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 18a19a8d-e121-4f9d-8906-574d6ecce160] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:03.295415 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8c64b4de-1479-4ebd-bbb3-12cef5cf812c tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:03.295865 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8c64b4de-1479-4ebd-bbb3-12cef5cf812c tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:03.296704 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8c64b4de-1479-4ebd-bbb3-12cef5cf812c tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:03.297115 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8c64b4de-1479-4ebd-bbb3-12cef5cf812c tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:03.323775 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-d5cad117-3414-4932-9dd7-c1926ec62d89 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:03.325630 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-d5cad117-3414-4932-9dd7-c1926ec62d89 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:03.332373 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d5cad117-3414-4932-9dd7-c1926ec62d89 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:03.332813 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d5cad117-3414-4932-9dd7-c1926ec62d89 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:03.342496 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d5cad117-3414-4932-9dd7-c1926ec62d89 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:03.343178 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d5cad117-3414-4932-9dd7-c1926ec62d89 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:03.374805 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=100 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:01:03.391480 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-8c64b4de-1479-4ebd-bbb3-12cef5cf812c tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:03.400081 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-8c64b4de-1479-4ebd-bbb3-12cef5cf812c tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160" status: 200 len: 1299 microversion: 2.1 time: 0.119752 Jun 30 10:01:03.400934 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 38/64] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:03 2022] GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160 => generated 1299 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:03.422021 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-d5cad117-3414-4932-9dd7-c1926ec62d89 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:03.430490 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-d5cad117-3414-4932-9dd7-c1926ec62d89 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:03.432888 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-d5cad117-3414-4932-9dd7-c1926ec62d89 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:03.434245 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-d5cad117-3414-4932-9dd7-c1926ec62d89 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1342 microversion: 2.20 time: 0.115635 Jun 30 10:01:03.444950 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 27/65] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:01:03 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1342 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:01:03.525118 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [req-272cbe83-9cc2-4082-83d4-dc9513d633d8 req-e510b58e-9bc2-4695-95c1-5e4c328a3d47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b918deb4-fb3e-4cf4-8057-50802bd5af36", "tag": "f392866f-edc8-4026-8404-36345b63925a"}]} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:01:03.533617 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-272cbe83-9cc2-4082-83d4-dc9513d633d8 req-e510b58e-9bc2-4695-95c1-5e4c328a3d47 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:03.534052 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-272cbe83-9cc2-4082-83d4-dc9513d633d8 req-e510b58e-9bc2-4695-95c1-5e4c328a3d47 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:03.545578 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.compute.server_external_events [req-272cbe83-9cc2-4082-83d4-dc9513d633d8 req-e510b58e-9bc2-4695-95c1-5e4c328a3d47 service nova] Creating event network-changed:f392866f-edc8-4026-8404-36345b63925a for instance b918deb4-fb3e-4cf4-8057-50802bd5af36 on hv-cinder-84330 Jun 30 10:01:03.550815 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [req-272cbe83-9cc2-4082-83d4-dc9513d633d8 req-e510b58e-9bc2-4695-95c1-5e4c328a3d47 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096893 Jun 30 10:01:03.551409 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 39/66] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:01:03.665224 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-2c41d8d4-78de-49b5-8d07-317d2d11bb7c tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:03.665977 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-2c41d8d4-78de-49b5-8d07-317d2d11bb7c tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] [instance: b918deb4-fb3e-4cf4-8057-50802bd5af36] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:03.672550 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2c41d8d4-78de-49b5-8d07-317d2d11bb7c tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:03.672990 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2c41d8d4-78de-49b5-8d07-317d2d11bb7c tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:03.673737 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2c41d8d4-78de-49b5-8d07-317d2d11bb7c tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:03.674175 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2c41d8d4-78de-49b5-8d07-317d2d11bb7c tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:03.743975 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-02baabfc-6acc-4063-a34b-4c425f798742 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:03.744666 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-02baabfc-6acc-4063-a34b-4c425f798742 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:03.750997 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-02baabfc-6acc-4063-a34b-4c425f798742 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:03.751440 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-02baabfc-6acc-4063-a34b-4c425f798742 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:03.752227 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-02baabfc-6acc-4063-a34b-4c425f798742 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:03.752653 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-02baabfc-6acc-4063-a34b-4c425f798742 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:03.832571 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-2c41d8d4-78de-49b5-8d07-317d2d11bb7c tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a8708943a94915970a0ff89b9f17e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b1cb0fcef4cbba01134acdba481be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:03.840525 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-2c41d8d4-78de-49b5-8d07-317d2d11bb7c tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] 10.222.0.16 "GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36" status: 200 len: 1314 microversion: 2.1 time: 0.180983 Jun 30 10:01:03.841101 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 28/67] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:03 2022] GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:03.899839 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-02baabfc-6acc-4063-a34b-4c425f798742 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:03.908850 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-02baabfc-6acc-4063-a34b-4c425f798742 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1322 microversion: 2.1 time: 0.169088 Jun 30 10:01:03.909462 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 40/68] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:03 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:04.417826 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f9d89c58-baa6-49c6-a644-457893ed855e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:04.418430 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f9d89c58-baa6-49c6-a644-457893ed855e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 18a19a8d-e121-4f9d-8906-574d6ecce160] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:04.420409 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=6 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:01:04.425932 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f9d89c58-baa6-49c6-a644-457893ed855e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:04.426370 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f9d89c58-baa6-49c6-a644-457893ed855e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:04.427130 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f9d89c58-baa6-49c6-a644-457893ed855e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:04.427557 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f9d89c58-baa6-49c6-a644-457893ed855e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:04.453557 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-c1e6fe7f-7439-49ca-93ec-6bc35ea2bf1f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:04.454186 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-c1e6fe7f-7439-49ca-93ec-6bc35ea2bf1f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:04.460783 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c1e6fe7f-7439-49ca-93ec-6bc35ea2bf1f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:04.461233 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c1e6fe7f-7439-49ca-93ec-6bc35ea2bf1f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:04.462062 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c1e6fe7f-7439-49ca-93ec-6bc35ea2bf1f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:04.462428 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c1e6fe7f-7439-49ca-93ec-6bc35ea2bf1f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:04.490391 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f9d89c58-baa6-49c6-a644-457893ed855e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:04.498406 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f9d89c58-baa6-49c6-a644-457893ed855e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160" status: 200 len: 1299 microversion: 2.1 time: 0.084498 Jun 30 10:01:04.498980 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 29/69] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:04 2022] GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160 => generated 1299 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:04.526373 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-c1e6fe7f-7439-49ca-93ec-6bc35ea2bf1f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:04.539382 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-c1e6fe7f-7439-49ca-93ec-6bc35ea2bf1f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:04.542271 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-c1e6fe7f-7439-49ca-93ec-6bc35ea2bf1f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:04.543902 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-c1e6fe7f-7439-49ca-93ec-6bc35ea2bf1f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1342 microversion: 2.20 time: 0.094286 Jun 30 10:01:04.544748 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 41/70] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:01:04 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1342 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:01:04.862079 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-dd4d29d8-0296-41e4-b05f-26b4785675a1 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:04.863030 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-dd4d29d8-0296-41e4-b05f-26b4785675a1 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] [instance: b918deb4-fb3e-4cf4-8057-50802bd5af36] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:04.872181 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-dd4d29d8-0296-41e4-b05f-26b4785675a1 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:04.872627 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-dd4d29d8-0296-41e4-b05f-26b4785675a1 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:04.873386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-dd4d29d8-0296-41e4-b05f-26b4785675a1 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:04.873819 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-dd4d29d8-0296-41e4-b05f-26b4785675a1 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:04.925854 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-ee469162-ddc9-4ace-b31d-b3e3b0ae80a7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:04.926461 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-ee469162-ddc9-4ace-b31d-b3e3b0ae80a7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:04.932852 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ee469162-ddc9-4ace-b31d-b3e3b0ae80a7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:04.933362 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ee469162-ddc9-4ace-b31d-b3e3b0ae80a7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:04.934053 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ee469162-ddc9-4ace-b31d-b3e3b0ae80a7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:04.934472 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ee469162-ddc9-4ace-b31d-b3e3b0ae80a7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:05.066530 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-dd4d29d8-0296-41e4-b05f-26b4785675a1 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a8708943a94915970a0ff89b9f17e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b1cb0fcef4cbba01134acdba481be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:05.075360 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-dd4d29d8-0296-41e4-b05f-26b4785675a1 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] 10.222.0.16 "GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36" status: 200 len: 1314 microversion: 2.1 time: 0.219710 Jun 30 10:01:05.076221 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 30/71] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:04 2022] GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:01:05.097039 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-ee469162-ddc9-4ace-b31d-b3e3b0ae80a7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:05.107418 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-ee469162-ddc9-4ace-b31d-b3e3b0ae80a7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1322 microversion: 2.1 time: 0.184910 Jun 30 10:01:05.116918 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 42/72] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:04 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:05.514426 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f5ed2559-f807-4324-aaa0-00ae1c1d9356 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:05.515173 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f5ed2559-f807-4324-aaa0-00ae1c1d9356 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 18a19a8d-e121-4f9d-8906-574d6ecce160] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:05.522817 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f5ed2559-f807-4324-aaa0-00ae1c1d9356 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:05.523472 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f5ed2559-f807-4324-aaa0-00ae1c1d9356 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:05.524646 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f5ed2559-f807-4324-aaa0-00ae1c1d9356 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:05.528951 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f5ed2559-f807-4324-aaa0-00ae1c1d9356 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:05.568952 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-a8bee234-c898-4d9a-a048-d53e9e71aea6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:05.570460 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-a8bee234-c898-4d9a-a048-d53e9e71aea6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:05.599012 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a8bee234-c898-4d9a-a048-d53e9e71aea6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:05.600948 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a8bee234-c898-4d9a-a048-d53e9e71aea6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:05.601966 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a8bee234-c898-4d9a-a048-d53e9e71aea6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:05.603464 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a8bee234-c898-4d9a-a048-d53e9e71aea6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:05.750458 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f5ed2559-f807-4324-aaa0-00ae1c1d9356 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:05.761290 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell0:SELECT=4 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:01:05.763093 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f5ed2559-f807-4324-aaa0-00ae1c1d9356 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160" status: 200 len: 1299 microversion: 2.1 time: 0.252344 Jun 30 10:01:05.763677 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 31/73] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:05 2022] GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160 => generated 1299 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:05.846777 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-a8bee234-c898-4d9a-a048-d53e9e71aea6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:05.855889 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-a8bee234-c898-4d9a-a048-d53e9e71aea6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:05.857567 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-a8bee234-c898-4d9a-a048-d53e9e71aea6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:05.858794 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-a8bee234-c898-4d9a-a048-d53e9e71aea6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1340 microversion: 2.20 time: 0.295397 Jun 30 10:01:05.862242 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 43/74] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:01:05 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1340 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:01:06.094879 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-04704f17-c1e3-4468-ab30-94afa2d5686c tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:06.095600 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-04704f17-c1e3-4468-ab30-94afa2d5686c tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] [instance: b918deb4-fb3e-4cf4-8057-50802bd5af36] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:06.107129 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-04704f17-c1e3-4468-ab30-94afa2d5686c tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:06.108227 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-04704f17-c1e3-4468-ab30-94afa2d5686c tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:06.109216 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-04704f17-c1e3-4468-ab30-94afa2d5686c tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:06.111521 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-04704f17-c1e3-4468-ab30-94afa2d5686c tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:06.128253 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-cbaab6a7-f0cb-42ea-be7a-23dbc3264414 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:06.129610 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-cbaab6a7-f0cb-42ea-be7a-23dbc3264414 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:06.151273 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-cbaab6a7-f0cb-42ea-be7a-23dbc3264414 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:06.153144 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-cbaab6a7-f0cb-42ea-be7a-23dbc3264414 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:06.154141 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-cbaab6a7-f0cb-42ea-be7a-23dbc3264414 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:06.156973 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-cbaab6a7-f0cb-42ea-be7a-23dbc3264414 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:06.524298 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=6 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:01:06.548679 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=16 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:01:06.692818 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell0:SELECT=30 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:01:06.891631 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-04704f17-c1e3-4468-ab30-94afa2d5686c tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a8708943a94915970a0ff89b9f17e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b1cb0fcef4cbba01134acdba481be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:06.901674 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-04704f17-c1e3-4468-ab30-94afa2d5686c tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] 10.222.0.16 "GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36" status: 200 len: 1314 microversion: 2.1 time: 0.810434 Jun 30 10:01:06.902283 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 32/75] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:06 2022] GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36 => generated 1314 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:06.909264 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-7fd23f08-9cff-4fb1-8664-e97be1df3ebf tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:06.910148 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-7fd23f08-9cff-4fb1-8664-e97be1df3ebf tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 18a19a8d-e121-4f9d-8906-574d6ecce160] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:06.917571 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7fd23f08-9cff-4fb1-8664-e97be1df3ebf tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:06.917882 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7fd23f08-9cff-4fb1-8664-e97be1df3ebf tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:06.919142 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7fd23f08-9cff-4fb1-8664-e97be1df3ebf tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:06.919678 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7fd23f08-9cff-4fb1-8664-e97be1df3ebf tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:06.965786 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-cbaab6a7-f0cb-42ea-be7a-23dbc3264414 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:06.991092 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-cbaab6a7-f0cb-42ea-be7a-23dbc3264414 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1322 microversion: 2.1 time: 0.864291 Jun 30 10:01:06.993171 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 44/76] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:06 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1322 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:01:07.005235 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-d91e2312-fe77-4bbb-bc86-713c4b62ecaf tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:07.006051 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-d91e2312-fe77-4bbb-bc86-713c4b62ecaf tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:07.014563 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d91e2312-fe77-4bbb-bc86-713c4b62ecaf tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:07.015155 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d91e2312-fe77-4bbb-bc86-713c4b62ecaf tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:07.016014 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d91e2312-fe77-4bbb-bc86-713c4b62ecaf tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:07.016440 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d91e2312-fe77-4bbb-bc86-713c4b62ecaf tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:07.107364 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-d91e2312-fe77-4bbb-bc86-713c4b62ecaf tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:07.116715 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-d91e2312-fe77-4bbb-bc86-713c4b62ecaf tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:07.118417 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-d91e2312-fe77-4bbb-bc86-713c4b62ecaf tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:07.135581 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-d91e2312-fe77-4bbb-bc86-713c4b62ecaf tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1340 microversion: 2.20 time: 0.135913 Jun 30 10:01:07.136741 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 45/77] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:01:06 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1340 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:01:07.267330 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7fd23f08-9cff-4fb1-8664-e97be1df3ebf tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:07.293555 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-7fd23f08-9cff-4fb1-8664-e97be1df3ebf tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160" status: 200 len: 1367 microversion: 2.1 time: 0.382170 Jun 30 10:01:07.294238 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 33/78] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:06 2022] GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160 => generated 1367 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:07.922052 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-7eb07af3-c73d-4e63-bad4-120c2d2ecfb6 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:07.923755 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-7eb07af3-c73d-4e63-bad4-120c2d2ecfb6 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] [instance: b918deb4-fb3e-4cf4-8057-50802bd5af36] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:07.931678 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7eb07af3-c73d-4e63-bad4-120c2d2ecfb6 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:07.932666 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7eb07af3-c73d-4e63-bad4-120c2d2ecfb6 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:07.933608 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7eb07af3-c73d-4e63-bad4-120c2d2ecfb6 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:07.934152 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7eb07af3-c73d-4e63-bad4-120c2d2ecfb6 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:08.010740 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-1393c70e-0998-498e-b16e-8fed436c0280 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:08.012117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-1393c70e-0998-498e-b16e-8fed436c0280 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:08.019115 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1393c70e-0998-498e-b16e-8fed436c0280 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:08.020017 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1393c70e-0998-498e-b16e-8fed436c0280 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:08.021113 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1393c70e-0998-498e-b16e-8fed436c0280 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:08.021701 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1393c70e-0998-498e-b16e-8fed436c0280 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:08.318607 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-7eb07af3-c73d-4e63-bad4-120c2d2ecfb6 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a8708943a94915970a0ff89b9f17e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b1cb0fcef4cbba01134acdba481be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:08.325421 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-1393c70e-0998-498e-b16e-8fed436c0280 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:08.326963 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-7eb07af3-c73d-4e63-bad4-120c2d2ecfb6 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] 10.222.0.16 "GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36" status: 200 len: 1314 microversion: 2.1 time: 0.410866 Jun 30 10:01:08.336412 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-1393c70e-0998-498e-b16e-8fed436c0280 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1322 microversion: 2.1 time: 0.329771 Jun 30 10:01:08.337362 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 46/79] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:07 2022] GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36 => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:08.337672 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 34/80] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:08 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1322 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:01:08.344157 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-b0454bce-2bde-455c-9b09-e66842f7a077 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:08.345119 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-b0454bce-2bde-455c-9b09-e66842f7a077 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 18a19a8d-e121-4f9d-8906-574d6ecce160] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:08.351265 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-9d4f478b-bc1e-43ba-b918-594a3bbf2ef9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:08.352134 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-9d4f478b-bc1e-43ba-b918-594a3bbf2ef9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:08.353101 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b0454bce-2bde-455c-9b09-e66842f7a077 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:08.353741 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b0454bce-2bde-455c-9b09-e66842f7a077 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:08.355426 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b0454bce-2bde-455c-9b09-e66842f7a077 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:08.356016 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b0454bce-2bde-455c-9b09-e66842f7a077 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:08.359116 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9d4f478b-bc1e-43ba-b918-594a3bbf2ef9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:08.359752 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9d4f478b-bc1e-43ba-b918-594a3bbf2ef9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:08.361342 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9d4f478b-bc1e-43ba-b918-594a3bbf2ef9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:08.361727 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9d4f478b-bc1e-43ba-b918-594a3bbf2ef9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:08.700757 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-9d4f478b-bc1e-43ba-b918-594a3bbf2ef9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:08.713737 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-9d4f478b-bc1e-43ba-b918-594a3bbf2ef9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:08.714748 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-b0454bce-2bde-455c-9b09-e66842f7a077 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:08.716843 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-9d4f478b-bc1e-43ba-b918-594a3bbf2ef9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:08.723914 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-9d4f478b-bc1e-43ba-b918-594a3bbf2ef9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1408 microversion: 2.20 time: 0.376202 Jun 30 10:01:08.729728 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 47/81] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:01:08 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1408 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:01:08.731380 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-b0454bce-2bde-455c-9b09-e66842f7a077 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160" status: 200 len: 1367 microversion: 2.1 time: 0.392271 Jun 30 10:01:08.732052 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 35/82] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:08 2022] GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160 => generated 1367 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:09.346112 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-7127caa2-95a9-4045-9703-dfa88f0bd59f tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:09.350720 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-7127caa2-95a9-4045-9703-dfa88f0bd59f tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] [instance: b918deb4-fb3e-4cf4-8057-50802bd5af36] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:09.353702 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-489fe784-d698-406c-8f5f-727149ce393c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:09.354949 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-489fe784-d698-406c-8f5f-727149ce393c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:09.361891 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-489fe784-d698-406c-8f5f-727149ce393c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:09.362327 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-489fe784-d698-406c-8f5f-727149ce393c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:09.363108 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-489fe784-d698-406c-8f5f-727149ce393c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:09.363217 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7127caa2-95a9-4045-9703-dfa88f0bd59f tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:09.363521 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-489fe784-d698-406c-8f5f-727149ce393c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:09.363633 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7127caa2-95a9-4045-9703-dfa88f0bd59f tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:09.364693 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7127caa2-95a9-4045-9703-dfa88f0bd59f tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:09.370471 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7127caa2-95a9-4045-9703-dfa88f0bd59f tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:10.004091 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-489fe784-d698-406c-8f5f-727149ce393c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:10.014930 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-489fe784-d698-406c-8f5f-727149ce393c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1322 microversion: 2.1 time: 0.664615 Jun 30 10:01:10.016500 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 36/83] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:09 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1322 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:01:10.021827 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-d489c206-dac5-4e00-80c5-c4e155333e8a req-6bb83996-9879-4dde-9ca8-864c54044ab1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c15c69f-e851-41aa-9f31-0e897b2f302d", "tag": "c1be8ae5-cf30-4b83-be1b-6a94517a895b"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:01:10.037351 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-d489c206-dac5-4e00-80c5-c4e155333e8a req-6bb83996-9879-4dde-9ca8-864c54044ab1 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:10.038168 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-d489c206-dac5-4e00-80c5-c4e155333e8a req-6bb83996-9879-4dde-9ca8-864c54044ab1 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:10.074185 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-d489c206-dac5-4e00-80c5-c4e155333e8a req-6bb83996-9879-4dde-9ca8-864c54044ab1 service nova] Creating event network-changed:c1be8ae5-cf30-4b83-be1b-6a94517a895b for instance 8c15c69f-e851-41aa-9f31-0e897b2f302d on hv-cinder-84330 Jun 30 10:01:10.084572 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-d489c206-dac5-4e00-80c5-c4e155333e8a req-6bb83996-9879-4dde-9ca8-864c54044ab1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066492 Jun 30 10:01:10.087001 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 37/84] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:01:10.095102 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-4720ccd7-7490-4c49-a5b8-4f435e80902c req-108a05cf-bc77-4e94-9384-a8ff749f8461 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18a19a8d-e121-4f9d-8906-574d6ecce160", "tag": "1b857dd1-e79c-49ad-bc35-e8f33b08e271"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:01:10.107718 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-4720ccd7-7490-4c49-a5b8-4f435e80902c req-108a05cf-bc77-4e94-9384-a8ff749f8461 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:10.108862 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-4720ccd7-7490-4c49-a5b8-4f435e80902c req-108a05cf-bc77-4e94-9384-a8ff749f8461 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:10.123394 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-4720ccd7-7490-4c49-a5b8-4f435e80902c req-108a05cf-bc77-4e94-9384-a8ff749f8461 service nova] Creating event network-changed:1b857dd1-e79c-49ad-bc35-e8f33b08e271 for instance 18a19a8d-e121-4f9d-8906-574d6ecce160 on hv-cinder-84330 Jun 30 10:01:10.132249 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-4720ccd7-7490-4c49-a5b8-4f435e80902c req-108a05cf-bc77-4e94-9384-a8ff749f8461 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042825 Jun 30 10:01:10.138261 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 38/85] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:01:10.153025 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-d12d3282-80e6-4d91-b304-f27dc73b73b7 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:10.154177 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-d12d3282-80e6-4d91-b304-f27dc73b73b7 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:10.168035 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d12d3282-80e6-4d91-b304-f27dc73b73b7 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:10.171027 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d12d3282-80e6-4d91-b304-f27dc73b73b7 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:10.172667 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d12d3282-80e6-4d91-b304-f27dc73b73b7 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:10.173434 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d12d3282-80e6-4d91-b304-f27dc73b73b7 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:10.190996 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-7127caa2-95a9-4045-9703-dfa88f0bd59f tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a8708943a94915970a0ff89b9f17e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b1cb0fcef4cbba01134acdba481be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:10.200890 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-7127caa2-95a9-4045-9703-dfa88f0bd59f tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] 10.222.0.16 "GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36" status: 200 len: 1314 microversion: 2.1 time: 0.860357 Jun 30 10:01:10.211476 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 48/86] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:09 2022] GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36 => generated 1314 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:10.216753 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-58af8c2b-1de6-4441-9644-97640f7c8186 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:10.217372 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-58af8c2b-1de6-4441-9644-97640f7c8186 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 18a19a8d-e121-4f9d-8906-574d6ecce160] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:10.238875 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-58af8c2b-1de6-4441-9644-97640f7c8186 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:10.239339 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-58af8c2b-1de6-4441-9644-97640f7c8186 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:10.240139 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-58af8c2b-1de6-4441-9644-97640f7c8186 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:10.240573 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-58af8c2b-1de6-4441-9644-97640f7c8186 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:10.866700 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-58af8c2b-1de6-4441-9644-97640f7c8186 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:10.874645 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-58af8c2b-1de6-4441-9644-97640f7c8186 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160" status: 200 len: 1367 microversion: 2.1 time: 0.662008 Jun 30 10:01:10.875227 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 49/87] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:10 2022] GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160 => generated 1367 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:10.905574 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-d12d3282-80e6-4d91-b304-f27dc73b73b7 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:10.920189 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-d12d3282-80e6-4d91-b304-f27dc73b73b7 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:10.924874 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-d12d3282-80e6-4d91-b304-f27dc73b73b7 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:10.927506 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-d12d3282-80e6-4d91-b304-f27dc73b73b7 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1408 microversion: 2.20 time: 0.787624 Jun 30 10:01:10.938993 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 39/88] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:01:10 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1408 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:01:11.033476 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-b7402007-5ebb-41e5-a2e1-ef373dbfab21 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:11.034071 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-b7402007-5ebb-41e5-a2e1-ef373dbfab21 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:11.046468 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b7402007-5ebb-41e5-a2e1-ef373dbfab21 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:11.046834 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b7402007-5ebb-41e5-a2e1-ef373dbfab21 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:11.047613 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b7402007-5ebb-41e5-a2e1-ef373dbfab21 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:11.048091 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b7402007-5ebb-41e5-a2e1-ef373dbfab21 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:11.212249 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-b7402007-5ebb-41e5-a2e1-ef373dbfab21 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:11.217709 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-cdd946dc-5a3d-4e50-b161-31061fc1ad1d tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:11.218324 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-cdd946dc-5a3d-4e50-b161-31061fc1ad1d tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] [instance: b918deb4-fb3e-4cf4-8057-50802bd5af36] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:11.229123 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-b7402007-5ebb-41e5-a2e1-ef373dbfab21 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1322 microversion: 2.1 time: 0.197608 Jun 30 10:01:11.232703 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cdd946dc-5a3d-4e50-b161-31061fc1ad1d tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:11.233512 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 50/89] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:11 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:11.234211 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cdd946dc-5a3d-4e50-b161-31061fc1ad1d tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:11.235317 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cdd946dc-5a3d-4e50-b161-31061fc1ad1d tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:11.236147 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cdd946dc-5a3d-4e50-b161-31061fc1ad1d tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:11.408167 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-cdd946dc-5a3d-4e50-b161-31061fc1ad1d tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a8708943a94915970a0ff89b9f17e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b1cb0fcef4cbba01134acdba481be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:11.418509 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-cdd946dc-5a3d-4e50-b161-31061fc1ad1d tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] 10.222.0.16 "GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36" status: 200 len: 1314 microversion: 2.1 time: 0.204448 Jun 30 10:01:11.438101 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 40/90] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:11 2022] GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:01:11.890441 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-53080176-dd39-4c74-a5b2-d48ad2e1f609 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:11.891049 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-53080176-dd39-4c74-a5b2-d48ad2e1f609 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 18a19a8d-e121-4f9d-8906-574d6ecce160] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:11.910199 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-53080176-dd39-4c74-a5b2-d48ad2e1f609 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:11.910199 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-53080176-dd39-4c74-a5b2-d48ad2e1f609 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:11.910199 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-53080176-dd39-4c74-a5b2-d48ad2e1f609 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:11.910199 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-53080176-dd39-4c74-a5b2-d48ad2e1f609 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:11.946241 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ac1f9c81-2295-4c8e-85df-ed44ecfb792a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:11.946831 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-ac1f9c81-2295-4c8e-85df-ed44ecfb792a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:11.961840 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ac1f9c81-2295-4c8e-85df-ed44ecfb792a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:11.962401 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ac1f9c81-2295-4c8e-85df-ed44ecfb792a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:11.963055 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ac1f9c81-2295-4c8e-85df-ed44ecfb792a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:11.963722 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ac1f9c81-2295-4c8e-85df-ed44ecfb792a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:12.255557 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ac1f9c81-2295-4c8e-85df-ed44ecfb792a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:12.258174 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-53080176-dd39-4c74-a5b2-d48ad2e1f609 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:12.266543 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-53080176-dd39-4c74-a5b2-d48ad2e1f609 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160" status: 200 len: 1367 microversion: 2.1 time: 0.379823 Jun 30 10:01:12.267773 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ac1f9c81-2295-4c8e-85df-ed44ecfb792a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:12.269752 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ac1f9c81-2295-4c8e-85df-ed44ecfb792a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:12.271587 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ac1f9c81-2295-4c8e-85df-ed44ecfb792a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1408 microversion: 2.20 time: 0.329524 Jun 30 10:01:12.283694 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 41/91] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:01:11 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1408 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:01:12.289605 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-107e98d2-206f-4333-a779-a4449fa52b0b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:12.290571 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-107e98d2-206f-4333-a779-a4449fa52b0b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:12.293209 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 51/92] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:11 2022] GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160 => generated 1367 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:12.298744 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-107e98d2-206f-4333-a779-a4449fa52b0b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:12.299357 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-107e98d2-206f-4333-a779-a4449fa52b0b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:12.300305 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-107e98d2-206f-4333-a779-a4449fa52b0b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:12.300872 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-107e98d2-206f-4333-a779-a4449fa52b0b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:12.434497 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-39fb25b1-6830-48eb-933d-07e751ed97fa tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:12.435102 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-39fb25b1-6830-48eb-933d-07e751ed97fa tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] [instance: b918deb4-fb3e-4cf4-8057-50802bd5af36] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:12.451526 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-39fb25b1-6830-48eb-933d-07e751ed97fa tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:12.452021 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-39fb25b1-6830-48eb-933d-07e751ed97fa tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:12.452904 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-39fb25b1-6830-48eb-933d-07e751ed97fa tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:12.453281 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-39fb25b1-6830-48eb-933d-07e751ed97fa tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:12.503149 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell1:SELECT=100 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:01:12.668720 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-107e98d2-206f-4333-a779-a4449fa52b0b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:12.682798 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-107e98d2-206f-4333-a779-a4449fa52b0b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1322 microversion: 2.1 time: 0.396218 Jun 30 10:01:12.684615 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 42/93] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:12 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1322 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:12.693143 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-39fb25b1-6830-48eb-933d-07e751ed97fa tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a8708943a94915970a0ff89b9f17e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b1cb0fcef4cbba01134acdba481be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:12.702222 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-39fb25b1-6830-48eb-933d-07e751ed97fa tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] 10.222.0.16 "GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36" status: 200 len: 1314 microversion: 2.1 time: 0.271538 Jun 30 10:01:12.702789 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 52/94] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:12 2022] GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:01:13.298521 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-e18c8e70-f95c-4cc8-9dc5-44a0dcd9005e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:13.300703 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-051cef19-5ab6-422b-952f-e042a51f7934 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:13.301325 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-051cef19-5ab6-422b-952f-e042a51f7934 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 18a19a8d-e121-4f9d-8906-574d6ecce160] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:13.302328 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-e18c8e70-f95c-4cc8-9dc5-44a0dcd9005e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:13.315482 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-051cef19-5ab6-422b-952f-e042a51f7934 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:13.315949 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-051cef19-5ab6-422b-952f-e042a51f7934 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:13.316708 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-051cef19-5ab6-422b-952f-e042a51f7934 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:13.317131 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-051cef19-5ab6-422b-952f-e042a51f7934 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:13.321651 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e18c8e70-f95c-4cc8-9dc5-44a0dcd9005e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:13.322166 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e18c8e70-f95c-4cc8-9dc5-44a0dcd9005e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:13.323320 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e18c8e70-f95c-4cc8-9dc5-44a0dcd9005e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:13.323898 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e18c8e70-f95c-4cc8-9dc5-44a0dcd9005e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:13.544500 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-051cef19-5ab6-422b-952f-e042a51f7934 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:13.552825 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-e18c8e70-f95c-4cc8-9dc5-44a0dcd9005e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:13.557033 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-051cef19-5ab6-422b-952f-e042a51f7934 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160" status: 200 len: 1367 microversion: 2.1 time: 0.273801 Jun 30 10:01:13.562636 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-e18c8e70-f95c-4cc8-9dc5-44a0dcd9005e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:13.564292 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-e18c8e70-f95c-4cc8-9dc5-44a0dcd9005e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:13.565627 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-e18c8e70-f95c-4cc8-9dc5-44a0dcd9005e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1408 microversion: 2.20 time: 0.278782 Jun 30 10:01:13.566250 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 53/95] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:01:13 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1408 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:01:13.567621 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 43/96] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:13 2022] GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160 => generated 1367 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:13.701466 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-72be62c3-21d9-4a24-bf3c-0e032ded6596 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:13.702153 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-72be62c3-21d9-4a24-bf3c-0e032ded6596 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:13.708939 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-72be62c3-21d9-4a24-bf3c-0e032ded6596 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:13.709648 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-72be62c3-21d9-4a24-bf3c-0e032ded6596 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:13.710679 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-72be62c3-21d9-4a24-bf3c-0e032ded6596 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:13.711420 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-72be62c3-21d9-4a24-bf3c-0e032ded6596 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:13.719251 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-63bb1c63-a3d8-45cc-ab64-90895ed77f06 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:13.720184 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-63bb1c63-a3d8-45cc-ab64-90895ed77f06 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] [instance: b918deb4-fb3e-4cf4-8057-50802bd5af36] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:13.726700 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-63bb1c63-a3d8-45cc-ab64-90895ed77f06 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:13.737686 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-63bb1c63-a3d8-45cc-ab64-90895ed77f06 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:13.737686 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-63bb1c63-a3d8-45cc-ab64-90895ed77f06 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:13.737686 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-63bb1c63-a3d8-45cc-ab64-90895ed77f06 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:13.942854 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-72be62c3-21d9-4a24-bf3c-0e032ded6596 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:13.949885 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-63bb1c63-a3d8-45cc-ab64-90895ed77f06 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a8708943a94915970a0ff89b9f17e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b1cb0fcef4cbba01134acdba481be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:13.951079 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-72be62c3-21d9-4a24-bf3c-0e032ded6596 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1322 microversion: 2.1 time: 0.253785 Jun 30 10:01:13.952091 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 54/97] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:13 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:13.958936 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-63bb1c63-a3d8-45cc-ab64-90895ed77f06 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] 10.222.0.16 "GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36" status: 200 len: 1314 microversion: 2.1 time: 0.243260 Jun 30 10:01:13.964437 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 44/98] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:13 2022] GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:14.574438 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-ab29943c-a8c3-47a2-9b6c-b5d6e8ddf868 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:14.575039 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-ab29943c-a8c3-47a2-9b6c-b5d6e8ddf868 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 18a19a8d-e121-4f9d-8906-574d6ecce160] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:14.583235 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ab29943c-a8c3-47a2-9b6c-b5d6e8ddf868 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:14.583679 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ab29943c-a8c3-47a2-9b6c-b5d6e8ddf868 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:14.584092 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-a235b645-d466-4ee9-ab6c-fbe069ba87b5 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:14.584626 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ab29943c-a8c3-47a2-9b6c-b5d6e8ddf868 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:14.585078 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ab29943c-a8c3-47a2-9b6c-b5d6e8ddf868 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:14.585442 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-a235b645-d466-4ee9-ab6c-fbe069ba87b5 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:14.591841 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a235b645-d466-4ee9-ab6c-fbe069ba87b5 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:14.592305 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a235b645-d466-4ee9-ab6c-fbe069ba87b5 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:14.593075 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a235b645-d466-4ee9-ab6c-fbe069ba87b5 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:14.593642 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a235b645-d466-4ee9-ab6c-fbe069ba87b5 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:14.598114 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=100 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:01:14.777484 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-ab29943c-a8c3-47a2-9b6c-b5d6e8ddf868 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:14.785377 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-ab29943c-a8c3-47a2-9b6c-b5d6e8ddf868 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160" status: 200 len: 1367 microversion: 2.1 time: 0.215184 Jun 30 10:01:14.785921 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 55/99] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:14 2022] GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160 => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:14.792767 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-a235b645-d466-4ee9-ab6c-fbe069ba87b5 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:14.801135 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-a235b645-d466-4ee9-ab6c-fbe069ba87b5 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:14.802648 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-a235b645-d466-4ee9-ab6c-fbe069ba87b5 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:14.803744 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-a235b645-d466-4ee9-ab6c-fbe069ba87b5 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1408 microversion: 2.20 time: 0.223716 Jun 30 10:01:14.804343 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 45/100] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:01:14 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1408 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:01:14.972704 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-bba66c6e-2d82-49ed-b406-1847b0290c1e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:14.973605 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-bba66c6e-2d82-49ed-b406-1847b0290c1e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:14.981313 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-a74020c4-c2d4-406b-b4f6-42073b40a9ea tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:14.981913 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-a74020c4-c2d4-406b-b4f6-42073b40a9ea tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] [instance: b918deb4-fb3e-4cf4-8057-50802bd5af36] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:14.982063 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-bba66c6e-2d82-49ed-b406-1847b0290c1e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:14.982452 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-bba66c6e-2d82-49ed-b406-1847b0290c1e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:14.983205 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-bba66c6e-2d82-49ed-b406-1847b0290c1e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:14.983631 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-bba66c6e-2d82-49ed-b406-1847b0290c1e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:14.988541 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a74020c4-c2d4-406b-b4f6-42073b40a9ea tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:14.988976 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a74020c4-c2d4-406b-b4f6-42073b40a9ea tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:14.989728 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a74020c4-c2d4-406b-b4f6-42073b40a9ea tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:14.990148 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a74020c4-c2d4-406b-b4f6-42073b40a9ea tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:15.228603 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-a74020c4-c2d4-406b-b4f6-42073b40a9ea tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a8708943a94915970a0ff89b9f17e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b1cb0fcef4cbba01134acdba481be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:15.242842 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-a74020c4-c2d4-406b-b4f6-42073b40a9ea tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] 10.222.0.16 "GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36" status: 200 len: 1314 microversion: 2.1 time: 0.266709 Jun 30 10:01:15.243049 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-bba66c6e-2d82-49ed-b406-1847b0290c1e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:15.256250 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 46/101] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:14 2022] GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:15.264721 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-bba66c6e-2d82-49ed-b406-1847b0290c1e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1322 microversion: 2.1 time: 0.298454 Jun 30 10:01:15.276130 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 56/102] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:14 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1322 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:15.801303 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-576690eb-d279-480b-8fe3-89f2e665d700 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:15.801913 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-576690eb-d279-480b-8fe3-89f2e665d700 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 18a19a8d-e121-4f9d-8906-574d6ecce160] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:15.808292 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-576690eb-d279-480b-8fe3-89f2e665d700 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:15.808743 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-576690eb-d279-480b-8fe3-89f2e665d700 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:15.809517 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-576690eb-d279-480b-8fe3-89f2e665d700 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:15.809936 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-576690eb-d279-480b-8fe3-89f2e665d700 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:15.823031 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-b709bdc6-3182-4046-b1dd-ee13ccea1ec6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:15.823736 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-b709bdc6-3182-4046-b1dd-ee13ccea1ec6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:15.829980 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b709bdc6-3182-4046-b1dd-ee13ccea1ec6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:15.830683 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b709bdc6-3182-4046-b1dd-ee13ccea1ec6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:15.831502 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b709bdc6-3182-4046-b1dd-ee13ccea1ec6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:15.832042 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b709bdc6-3182-4046-b1dd-ee13ccea1ec6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:16.018219 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-576690eb-d279-480b-8fe3-89f2e665d700 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:16.024676 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-b709bdc6-3182-4046-b1dd-ee13ccea1ec6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:16.025966 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-576690eb-d279-480b-8fe3-89f2e665d700 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160" status: 200 len: 1367 microversion: 2.1 time: 0.228488 Jun 30 10:01:16.026542 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 47/103] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:15 2022] GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160 => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:16.033594 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-b709bdc6-3182-4046-b1dd-ee13ccea1ec6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:16.035093 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-b709bdc6-3182-4046-b1dd-ee13ccea1ec6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:16.036226 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-b709bdc6-3182-4046-b1dd-ee13ccea1ec6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1408 microversion: 2.20 time: 0.217524 Jun 30 10:01:16.036774 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 57/104] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:01:15 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1408 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:01:16.261039 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-1bcfd8ac-a5d1-44aa-a3ff-f1ef40d0c261 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:16.261636 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-1bcfd8ac-a5d1-44aa-a3ff-f1ef40d0c261 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] [instance: b918deb4-fb3e-4cf4-8057-50802bd5af36] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:16.267650 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1bcfd8ac-a5d1-44aa-a3ff-f1ef40d0c261 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:16.268120 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1bcfd8ac-a5d1-44aa-a3ff-f1ef40d0c261 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:16.268925 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1bcfd8ac-a5d1-44aa-a3ff-f1ef40d0c261 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:16.269285 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1bcfd8ac-a5d1-44aa-a3ff-f1ef40d0c261 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:16.283373 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-02646ff6-53d3-4b90-993a-bb50d1b2344f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:16.284000 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-02646ff6-53d3-4b90-993a-bb50d1b2344f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:16.295765 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-02646ff6-53d3-4b90-993a-bb50d1b2344f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:16.296261 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-02646ff6-53d3-4b90-993a-bb50d1b2344f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:16.297024 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-02646ff6-53d3-4b90-993a-bb50d1b2344f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:16.297447 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-02646ff6-53d3-4b90-993a-bb50d1b2344f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:16.498076 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-1bcfd8ac-a5d1-44aa-a3ff-f1ef40d0c261 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a8708943a94915970a0ff89b9f17e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b1cb0fcef4cbba01134acdba481be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:16.502634 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-02646ff6-53d3-4b90-993a-bb50d1b2344f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:16.511275 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-1bcfd8ac-a5d1-44aa-a3ff-f1ef40d0c261 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] 10.222.0.16 "GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36" status: 200 len: 1314 microversion: 2.1 time: 0.254010 Jun 30 10:01:16.511920 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 48/105] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:16 2022] GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:16.517757 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-02646ff6-53d3-4b90-993a-bb50d1b2344f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1322 microversion: 2.1 time: 0.238998 Jun 30 10:01:16.519339 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 58/106] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:16 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:01:17.042840 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-5c64cd63-9fdc-4c31-959c-7d55ada5bf7e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:17.043489 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-5c64cd63-9fdc-4c31-959c-7d55ada5bf7e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 18a19a8d-e121-4f9d-8906-574d6ecce160] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:17.049961 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5c64cd63-9fdc-4c31-959c-7d55ada5bf7e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:17.050562 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5c64cd63-9fdc-4c31-959c-7d55ada5bf7e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:17.051299 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5c64cd63-9fdc-4c31-959c-7d55ada5bf7e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:17.051755 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5c64cd63-9fdc-4c31-959c-7d55ada5bf7e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:17.055521 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-2be07731-e058-4a15-b0de-0d00f6d5deba tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:17.057474 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-2be07731-e058-4a15-b0de-0d00f6d5deba tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:17.062826 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2be07731-e058-4a15-b0de-0d00f6d5deba tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:17.063261 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2be07731-e058-4a15-b0de-0d00f6d5deba tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:17.064784 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2be07731-e058-4a15-b0de-0d00f6d5deba tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:17.065203 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2be07731-e058-4a15-b0de-0d00f6d5deba tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:17.263651 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-5c64cd63-9fdc-4c31-959c-7d55ada5bf7e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:17.274114 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-5c64cd63-9fdc-4c31-959c-7d55ada5bf7e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160" status: 200 len: 1367 microversion: 2.1 time: 0.235027 Jun 30 10:01:17.274866 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 49/107] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:17 2022] GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160 => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:17.293591 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-2be07731-e058-4a15-b0de-0d00f6d5deba tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:17.317349 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-2be07731-e058-4a15-b0de-0d00f6d5deba tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:17.318889 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-2be07731-e058-4a15-b0de-0d00f6d5deba tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:17.320205 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-2be07731-e058-4a15-b0de-0d00f6d5deba tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1408 microversion: 2.20 time: 0.269549 Jun 30 10:01:17.321883 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 59/108] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:01:17 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1408 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:01:17.535593 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-799d9322-bb20-492b-a4a1-8d21853ae516 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:17.536145 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-799d9322-bb20-492b-a4a1-8d21853ae516 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:17.537914 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-798d5d48-84b1-49d1-8390-cae62ce4fc67 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:17.539156 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-798d5d48-84b1-49d1-8390-cae62ce4fc67 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] [instance: b918deb4-fb3e-4cf4-8057-50802bd5af36] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:17.543834 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-799d9322-bb20-492b-a4a1-8d21853ae516 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:17.544293 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-799d9322-bb20-492b-a4a1-8d21853ae516 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:17.545226 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-799d9322-bb20-492b-a4a1-8d21853ae516 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:17.545819 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-799d9322-bb20-492b-a4a1-8d21853ae516 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:17.547249 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-798d5d48-84b1-49d1-8390-cae62ce4fc67 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:17.547675 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-798d5d48-84b1-49d1-8390-cae62ce4fc67 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:17.548460 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-798d5d48-84b1-49d1-8390-cae62ce4fc67 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:17.548896 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-798d5d48-84b1-49d1-8390-cae62ce4fc67 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:17.789286 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-799d9322-bb20-492b-a4a1-8d21853ae516 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:17.803177 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-799d9322-bb20-492b-a4a1-8d21853ae516 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1322 microversion: 2.1 time: 0.272002 Jun 30 10:01:17.804471 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-798d5d48-84b1-49d1-8390-cae62ce4fc67 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a8708943a94915970a0ff89b9f17e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b1cb0fcef4cbba01134acdba481be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:17.805281 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 50/109] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:17 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1322 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:17.814643 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-798d5d48-84b1-49d1-8390-cae62ce4fc67 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] 10.222.0.16 "GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36" status: 200 len: 1314 microversion: 2.1 time: 0.281329 Jun 30 10:01:17.815218 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 60/110] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:17 2022] GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:17.918097 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-962e3644-dee6-4051-9b99-8e8254d0e1f3 req-530b97c6-a268-413c-b6b3-96ce306348d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75c53f4a-19c7-4452-8243-40e32ce8c2b3", "name": "network-vif-plugged", "status": "completed", "tag": "a18a08f6-983b-4ecd-acd2-550b4a54f767"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:01:17.928014 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-962e3644-dee6-4051-9b99-8e8254d0e1f3 req-530b97c6-a268-413c-b6b3-96ce306348d4 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:17.928757 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-962e3644-dee6-4051-9b99-8e8254d0e1f3 req-530b97c6-a268-413c-b6b3-96ce306348d4 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:17.953359 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-962e3644-dee6-4051-9b99-8e8254d0e1f3 req-530b97c6-a268-413c-b6b3-96ce306348d4 service nova] Creating event network-vif-plugged:a18a08f6-983b-4ecd-acd2-550b4a54f767 for instance 75c53f4a-19c7-4452-8243-40e32ce8c2b3 on hv-cinder-84330 Jun 30 10:01:17.984826 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-962e3644-dee6-4051-9b99-8e8254d0e1f3 req-530b97c6-a268-413c-b6b3-96ce306348d4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149033 Jun 30 10:01:17.990599 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 51/111] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:01:18.293913 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-1f5cdd7f-4d2a-4bf4-a81a-477948b10002 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:18.303210 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-1f5cdd7f-4d2a-4bf4-a81a-477948b10002 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 18a19a8d-e121-4f9d-8906-574d6ecce160] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:18.320299 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1f5cdd7f-4d2a-4bf4-a81a-477948b10002 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:18.321966 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1f5cdd7f-4d2a-4bf4-a81a-477948b10002 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:18.324844 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1f5cdd7f-4d2a-4bf4-a81a-477948b10002 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:18.327501 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1f5cdd7f-4d2a-4bf4-a81a-477948b10002 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:18.339972 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-1d130e08-a647-4d45-9c0c-83f69b403ff2 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:18.340606 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-1d130e08-a647-4d45-9c0c-83f69b403ff2 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:18.352499 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1d130e08-a647-4d45-9c0c-83f69b403ff2 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:18.359010 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1d130e08-a647-4d45-9c0c-83f69b403ff2 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:18.362712 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1d130e08-a647-4d45-9c0c-83f69b403ff2 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:18.364175 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1d130e08-a647-4d45-9c0c-83f69b403ff2 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:18.826842 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-1f5cdd7f-4d2a-4bf4-a81a-477948b10002 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:18.832088 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-1d130e08-a647-4d45-9c0c-83f69b403ff2 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:18.841395 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-1f5cdd7f-4d2a-4bf4-a81a-477948b10002 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160" status: 200 len: 1367 microversion: 2.1 time: 0.550670 Jun 30 10:01:18.843650 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-1d130e08-a647-4d45-9c0c-83f69b403ff2 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:18.856451 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-1d130e08-a647-4d45-9c0c-83f69b403ff2 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:18.856451 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-1d130e08-a647-4d45-9c0c-83f69b403ff2 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1408 microversion: 2.20 time: 0.514532 Jun 30 10:01:18.856451 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 52/112] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:01:18 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1408 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:01:18.857351 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 61/113] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:18 2022] GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160 => generated 1367 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:18.862952 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-e3d3e851-2efe-429f-89af-f86f9415fa7b tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:18.863715 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-e3d3e851-2efe-429f-89af-f86f9415fa7b tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] [instance: b918deb4-fb3e-4cf4-8057-50802bd5af36] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:18.867045 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-611fafc4-0b0b-44d2-8c35-aad4544fec9e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:18.867731 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-611fafc4-0b0b-44d2-8c35-aad4544fec9e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:18.872341 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e3d3e851-2efe-429f-89af-f86f9415fa7b tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:18.872756 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e3d3e851-2efe-429f-89af-f86f9415fa7b tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:18.873529 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e3d3e851-2efe-429f-89af-f86f9415fa7b tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:18.874109 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e3d3e851-2efe-429f-89af-f86f9415fa7b tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:18.884409 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-611fafc4-0b0b-44d2-8c35-aad4544fec9e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:18.884857 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-611fafc4-0b0b-44d2-8c35-aad4544fec9e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:18.887240 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-611fafc4-0b0b-44d2-8c35-aad4544fec9e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:18.888463 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-611fafc4-0b0b-44d2-8c35-aad4544fec9e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:19.324757 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-e3d3e851-2efe-429f-89af-f86f9415fa7b tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a8708943a94915970a0ff89b9f17e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b1cb0fcef4cbba01134acdba481be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:19.329544 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-611fafc4-0b0b-44d2-8c35-aad4544fec9e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:19.335247 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-e3d3e851-2efe-429f-89af-f86f9415fa7b tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] 10.222.0.16 "GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36" status: 200 len: 1314 microversion: 2.1 time: 0.476610 Jun 30 10:01:19.335842 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 62/114] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:18 2022] GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36 => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:19.343068 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-611fafc4-0b0b-44d2-8c35-aad4544fec9e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1322 microversion: 2.1 time: 0.491128 Jun 30 10:01:19.344879 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 53/115] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:18 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1322 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:19.868540 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-91fc6b6b-fadd-41a9-9ce5-39f5f7ccfb43 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:19.869491 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-91fc6b6b-fadd-41a9-9ce5-39f5f7ccfb43 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 18a19a8d-e121-4f9d-8906-574d6ecce160] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:19.869802 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-b036bbea-8a00-4643-9c63-4ea5ef71a487 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:19.870596 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-b036bbea-8a00-4643-9c63-4ea5ef71a487 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:19.877883 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-91fc6b6b-fadd-41a9-9ce5-39f5f7ccfb43 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:19.878977 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-91fc6b6b-fadd-41a9-9ce5-39f5f7ccfb43 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:19.880740 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-91fc6b6b-fadd-41a9-9ce5-39f5f7ccfb43 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:19.881776 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b036bbea-8a00-4643-9c63-4ea5ef71a487 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:19.881939 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-91fc6b6b-fadd-41a9-9ce5-39f5f7ccfb43 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:19.882359 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b036bbea-8a00-4643-9c63-4ea5ef71a487 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:19.883225 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b036bbea-8a00-4643-9c63-4ea5ef71a487 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:19.883729 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b036bbea-8a00-4643-9c63-4ea5ef71a487 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:20.070929 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-b036bbea-8a00-4643-9c63-4ea5ef71a487 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:20.080605 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-b036bbea-8a00-4643-9c63-4ea5ef71a487 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:20.082390 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-b036bbea-8a00-4643-9c63-4ea5ef71a487 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:20.083825 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-b036bbea-8a00-4643-9c63-4ea5ef71a487 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1408 microversion: 2.20 time: 0.218286 Jun 30 10:01:20.084657 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 54/116] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:01:19 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1408 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:01:20.100663 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-4d8bb469-3637-4f7a-a0c3-db3257e2aa80 req-0f991b02-d53e-47e5-a591-d9a726f8fc15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18a19a8d-e121-4f9d-8906-574d6ecce160", "name": "network-vif-plugged", "status": "completed", "tag": "1b857dd1-e79c-49ad-bc35-e8f33b08e271"}, {"server_uuid": "3aa5453f-b4af-4817-a8d4-173f27d1cbd3", "name": "network-vif-plugged", "status": "completed", "tag": "940a702f-df85-4d3f-ab5f-e3a86923fecb"}, {"server_uuid": "b918deb4-fb3e-4cf4-8057-50802bd5af36", "name": "network-vif-plugged", "status": "completed", "tag": "f392866f-edc8-4026-8404-36345b63925a"}, {"server_uuid": "8c15c69f-e851-41aa-9f31-0e897b2f302d", "name": "network-vif-plugged", "status": "completed", "tag": "c1be8ae5-cf30-4b83-be1b-6a94517a895b"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:01:20.111456 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-4d8bb469-3637-4f7a-a0c3-db3257e2aa80 req-0f991b02-d53e-47e5-a591-d9a726f8fc15 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:20.111813 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-4d8bb469-3637-4f7a-a0c3-db3257e2aa80 req-0f991b02-d53e-47e5-a591-d9a726f8fc15 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:20.130790 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-4d8bb469-3637-4f7a-a0c3-db3257e2aa80 req-0f991b02-d53e-47e5-a591-d9a726f8fc15 service nova] Creating event network-vif-plugged:1b857dd1-e79c-49ad-bc35-e8f33b08e271 for instance 18a19a8d-e121-4f9d-8906-574d6ecce160 on hv-cinder-84330 Jun 30 10:01:20.131293 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-4d8bb469-3637-4f7a-a0c3-db3257e2aa80 req-0f991b02-d53e-47e5-a591-d9a726f8fc15 service nova] Creating event network-vif-plugged:940a702f-df85-4d3f-ab5f-e3a86923fecb for instance 3aa5453f-b4af-4817-a8d4-173f27d1cbd3 on hv-cinder-84330 Jun 30 10:01:20.131842 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-4d8bb469-3637-4f7a-a0c3-db3257e2aa80 req-0f991b02-d53e-47e5-a591-d9a726f8fc15 service nova] Creating event network-vif-plugged:f392866f-edc8-4026-8404-36345b63925a for instance b918deb4-fb3e-4cf4-8057-50802bd5af36 on hv-cinder-84330 Jun 30 10:01:20.132415 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-4d8bb469-3637-4f7a-a0c3-db3257e2aa80 req-0f991b02-d53e-47e5-a591-d9a726f8fc15 service nova] Creating event network-vif-plugged:c1be8ae5-cf30-4b83-be1b-6a94517a895b for instance 8c15c69f-e851-41aa-9f31-0e897b2f302d on hv-cinder-84330 Jun 30 10:01:20.137599 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-91fc6b6b-fadd-41a9-9ce5-39f5f7ccfb43 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:20.145339 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-4d8bb469-3637-4f7a-a0c3-db3257e2aa80 req-0f991b02-d53e-47e5-a591-d9a726f8fc15 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.048793 Jun 30 10:01:20.146518 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 55/117] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:01:20.149763 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-91fc6b6b-fadd-41a9-9ce5-39f5f7ccfb43 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160" status: 200 len: 1367 microversion: 2.1 time: 0.287851 Jun 30 10:01:20.151692 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 63/118] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:19 2022] GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160 => generated 1367 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:20.366798 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-1d635ddc-9b27-4648-8707-1e2cd8322845 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:20.367740 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-e9962f95-0456-40da-afc4-13d44ac7d0d8 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:20.369147 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-1d635ddc-9b27-4648-8707-1e2cd8322845 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:20.370005 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-e9962f95-0456-40da-afc4-13d44ac7d0d8 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] [instance: b918deb4-fb3e-4cf4-8057-50802bd5af36] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:20.383967 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1d635ddc-9b27-4648-8707-1e2cd8322845 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:20.385470 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e9962f95-0456-40da-afc4-13d44ac7d0d8 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:20.385874 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1d635ddc-9b27-4648-8707-1e2cd8322845 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:20.386462 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e9962f95-0456-40da-afc4-13d44ac7d0d8 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:20.387009 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1d635ddc-9b27-4648-8707-1e2cd8322845 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:20.387789 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e9962f95-0456-40da-afc4-13d44ac7d0d8 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:20.388375 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1d635ddc-9b27-4648-8707-1e2cd8322845 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:20.389720 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e9962f95-0456-40da-afc4-13d44ac7d0d8 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:20.708599 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-1d635ddc-9b27-4648-8707-1e2cd8322845 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:20.720315 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-1d635ddc-9b27-4648-8707-1e2cd8322845 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1322 microversion: 2.1 time: 0.359493 Jun 30 10:01:20.730889 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 56/119] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:20 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1322 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:20.791817 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-e9962f95-0456-40da-afc4-13d44ac7d0d8 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a8708943a94915970a0ff89b9f17e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b1cb0fcef4cbba01134acdba481be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:20.806397 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-e9962f95-0456-40da-afc4-13d44ac7d0d8 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] 10.222.0.16 "GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36" status: 200 len: 1314 microversion: 2.1 time: 0.445702 Jun 30 10:01:20.807271 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 64/120] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:20 2022] GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36 => generated 1314 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:21.106257 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-39bf56a1-7ccf-435a-8d71-c946672a3789 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:21.106953 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-39bf56a1-7ccf-435a-8d71-c946672a3789 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:21.114693 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-39bf56a1-7ccf-435a-8d71-c946672a3789 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:21.115458 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-39bf56a1-7ccf-435a-8d71-c946672a3789 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:21.116761 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-39bf56a1-7ccf-435a-8d71-c946672a3789 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:21.117645 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-39bf56a1-7ccf-435a-8d71-c946672a3789 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:21.167843 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-2c68b08d-391a-440d-919b-a1023d3b2c1f tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:21.169100 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-2c68b08d-391a-440d-919b-a1023d3b2c1f tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 18a19a8d-e121-4f9d-8906-574d6ecce160] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:21.177713 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2c68b08d-391a-440d-919b-a1023d3b2c1f tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:21.178479 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2c68b08d-391a-440d-919b-a1023d3b2c1f tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:21.179735 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2c68b08d-391a-440d-919b-a1023d3b2c1f tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:21.180385 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2c68b08d-391a-440d-919b-a1023d3b2c1f tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:21.342533 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-39bf56a1-7ccf-435a-8d71-c946672a3789 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:21.350519 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-39bf56a1-7ccf-435a-8d71-c946672a3789 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:21.352058 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-39bf56a1-7ccf-435a-8d71-c946672a3789 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:21.353160 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-39bf56a1-7ccf-435a-8d71-c946672a3789 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1408 microversion: 2.20 time: 0.253967 Jun 30 10:01:21.353713 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 57/121] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:01:21 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1408 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:01:21.384848 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-2c68b08d-391a-440d-919b-a1023d3b2c1f tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:21.396168 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-2c68b08d-391a-440d-919b-a1023d3b2c1f tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160" status: 200 len: 1367 microversion: 2.1 time: 0.232144 Jun 30 10:01:21.396742 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 65/122] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:21 2022] GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160 => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:01:21.737171 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ac367aa2-877c-403b-bd46-0e4155968c7c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:21.737775 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-ac367aa2-877c-403b-bd46-0e4155968c7c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:21.747674 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ac367aa2-877c-403b-bd46-0e4155968c7c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:21.748183 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ac367aa2-877c-403b-bd46-0e4155968c7c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:21.749118 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ac367aa2-877c-403b-bd46-0e4155968c7c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:21.749626 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ac367aa2-877c-403b-bd46-0e4155968c7c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:21.824973 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-33f0f367-2f9b-4d2e-8956-acaf5a7c90fb tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:21.825578 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-33f0f367-2f9b-4d2e-8956-acaf5a7c90fb tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] [instance: b918deb4-fb3e-4cf4-8057-50802bd5af36] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:21.840005 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-33f0f367-2f9b-4d2e-8956-acaf5a7c90fb tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:21.842184 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-33f0f367-2f9b-4d2e-8956-acaf5a7c90fb tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:21.844900 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-33f0f367-2f9b-4d2e-8956-acaf5a7c90fb tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:21.845353 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-33f0f367-2f9b-4d2e-8956-acaf5a7c90fb tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:22.124662 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ac367aa2-877c-403b-bd46-0e4155968c7c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:22.134531 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ac367aa2-877c-403b-bd46-0e4155968c7c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1517 microversion: 2.1 time: 0.401218 Jun 30 10:01:22.135184 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 58/123] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:21 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1517 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:22.154189 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-4eea236d-71b5-4205-8eec-9a18ae478828 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:01:22.156091 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-4eea236d-71b5-4205-8eec-9a18ae478828 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:22.164814 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4eea236d-71b5-4205-8eec-9a18ae478828 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:22.165730 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4eea236d-71b5-4205-8eec-9a18ae478828 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:22.166854 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4eea236d-71b5-4205-8eec-9a18ae478828 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:22.168531 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4eea236d-71b5-4205-8eec-9a18ae478828 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:22.179019 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-33f0f367-2f9b-4d2e-8956-acaf5a7c90fb tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a8708943a94915970a0ff89b9f17e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b1cb0fcef4cbba01134acdba481be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:22.200174 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-33f0f367-2f9b-4d2e-8956-acaf5a7c90fb tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] 10.222.0.16 "GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36" status: 200 len: 1314 microversion: 2.1 time: 0.371504 Jun 30 10:01:22.200174 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 66/124] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:21 2022] GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36 => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:01:22.261972 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.objects.instance [None req-4eea236d-71b5-4205-8eec-9a18ae478828 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lazy-loading 'flavor' on Instance uuid 75c53f4a-19c7-4452-8243-40e32ce8c2b3 {{(pid=117846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:01:22.371632 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-4280bb70-9e93-487f-80cd-5e46ddd40e95 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:22.372344 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-4280bb70-9e93-487f-80cd-5e46ddd40e95 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:22.382884 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4280bb70-9e93-487f-80cd-5e46ddd40e95 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:22.383328 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4280bb70-9e93-487f-80cd-5e46ddd40e95 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:22.386248 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4280bb70-9e93-487f-80cd-5e46ddd40e95 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:22.386931 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4280bb70-9e93-487f-80cd-5e46ddd40e95 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:22.452727 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-4eea236d-71b5-4205-8eec-9a18ae478828 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "POST /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3/action" status: 200 len: 32 microversion: 2.1 time: 0.303204 Jun 30 10:01:22.457904 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 59/125] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Jun 30 10:01:22 2022] POST /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3/action => generated 32 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 30 10:01:22.462386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-8b21b725-6f13-4be2-9afa-445ddb89bae2 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:22.464671 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-8b21b725-6f13-4be2-9afa-445ddb89bae2 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 18a19a8d-e121-4f9d-8906-574d6ecce160] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:22.472333 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8b21b725-6f13-4be2-9afa-445ddb89bae2 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:22.472774 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8b21b725-6f13-4be2-9afa-445ddb89bae2 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:22.473806 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8b21b725-6f13-4be2-9afa-445ddb89bae2 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:22.474422 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8b21b725-6f13-4be2-9afa-445ddb89bae2 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:22.749897 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-4280bb70-9e93-487f-80cd-5e46ddd40e95 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:22.759646 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-4280bb70-9e93-487f-80cd-5e46ddd40e95 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:22.760246 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-8b21b725-6f13-4be2-9afa-445ddb89bae2 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:22.768318 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-4280bb70-9e93-487f-80cd-5e46ddd40e95 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:22.769478 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-4280bb70-9e93-487f-80cd-5e46ddd40e95 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1408 microversion: 2.20 time: 0.402636 Jun 30 10:01:22.769987 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-8b21b725-6f13-4be2-9afa-445ddb89bae2 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160" status: 200 len: 1367 microversion: 2.1 time: 0.313972 Jun 30 10:01:22.770741 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 60/126] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:22 2022] GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160 => generated 1367 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:22.787733 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 67/127] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:01:22 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1408 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:01:22.795978 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-afb366bb-539e-426a-b2fd-6a4ecc8df9e5 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:22.796630 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-afb366bb-539e-426a-b2fd-6a4ecc8df9e5 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:22.805424 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-afb366bb-539e-426a-b2fd-6a4ecc8df9e5 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:22.805986 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-afb366bb-539e-426a-b2fd-6a4ecc8df9e5 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:22.821652 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-afb366bb-539e-426a-b2fd-6a4ecc8df9e5 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:22.823477 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-afb366bb-539e-426a-b2fd-6a4ecc8df9e5 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:22.862197 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:01:23.013570 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-afb366bb-539e-426a-b2fd-6a4ecc8df9e5 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:23.022494 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-afb366bb-539e-426a-b2fd-6a4ecc8df9e5 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1523 microversion: 2.1 time: 0.250488 Jun 30 10:01:23.023497 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 61/128] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:22 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1523 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:23.212386 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-fc983fb2-8b99-40dd-ad93-9c0e2cd8e488 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:23.212982 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-fc983fb2-8b99-40dd-ad93-9c0e2cd8e488 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] [instance: b918deb4-fb3e-4cf4-8057-50802bd5af36] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:23.219484 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-fc983fb2-8b99-40dd-ad93-9c0e2cd8e488 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:23.219850 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-fc983fb2-8b99-40dd-ad93-9c0e2cd8e488 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:23.220673 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-fc983fb2-8b99-40dd-ad93-9c0e2cd8e488 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:23.221009 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-fc983fb2-8b99-40dd-ad93-9c0e2cd8e488 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:23.390660 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-fc983fb2-8b99-40dd-ad93-9c0e2cd8e488 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a8708943a94915970a0ff89b9f17e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b1cb0fcef4cbba01134acdba481be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:23.394198 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell1:SELECT=100 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:01:23.402376 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-fc983fb2-8b99-40dd-ad93-9c0e2cd8e488 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] 10.222.0.16 "GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36" status: 200 len: 1500 microversion: 2.1 time: 0.195198 Jun 30 10:01:23.402952 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 68/129] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:23 2022] GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36 => generated 1500 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:23.819614 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-7fb39157-8a41-4b9b-a200-657d6a7af658 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:23.821220 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-24259ba2-cd23-47b4-bbc8-903803750268 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:23.822075 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-24259ba2-cd23-47b4-bbc8-903803750268 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 18a19a8d-e121-4f9d-8906-574d6ecce160] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:23.823744 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-7fb39157-8a41-4b9b-a200-657d6a7af658 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:23.846379 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-24259ba2-cd23-47b4-bbc8-903803750268 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:23.850530 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-24259ba2-cd23-47b4-bbc8-903803750268 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:23.851083 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7fb39157-8a41-4b9b-a200-657d6a7af658 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:23.855040 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7fb39157-8a41-4b9b-a200-657d6a7af658 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:23.855737 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-24259ba2-cd23-47b4-bbc8-903803750268 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:23.856424 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-24259ba2-cd23-47b4-bbc8-903803750268 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:23.857142 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7fb39157-8a41-4b9b-a200-657d6a7af658 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:23.858514 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7fb39157-8a41-4b9b-a200-657d6a7af658 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:24.437597 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-24259ba2-cd23-47b4-bbc8-903803750268 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:24.452582 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-24259ba2-cd23-47b4-bbc8-903803750268 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160" status: 200 len: 1367 microversion: 2.1 time: 0.654569 Jun 30 10:01:24.454506 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 69/130] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:23 2022] GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160 => generated 1367 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:24.460539 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-b2ce41d1-7443-4777-8b91-02b2ddcd8202 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:24.461454 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-b2ce41d1-7443-4777-8b91-02b2ddcd8202 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:24.469768 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b2ce41d1-7443-4777-8b91-02b2ddcd8202 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:24.473426 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7fb39157-8a41-4b9b-a200-657d6a7af658 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:24.477391 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b2ce41d1-7443-4777-8b91-02b2ddcd8202 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:24.480641 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b2ce41d1-7443-4777-8b91-02b2ddcd8202 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:24.483724 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7fb39157-8a41-4b9b-a200-657d6a7af658 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:24.484407 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b2ce41d1-7443-4777-8b91-02b2ddcd8202 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:24.488584 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7fb39157-8a41-4b9b-a200-657d6a7af658 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:24.489705 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-7fb39157-8a41-4b9b-a200-657d6a7af658 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1408 microversion: 2.20 time: 0.695647 Jun 30 10:01:24.490264 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 62/131] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:01:23 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1408 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:01:24.664699 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-b2ce41d1-7443-4777-8b91-02b2ddcd8202 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:24.675697 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-b2ce41d1-7443-4777-8b91-02b2ddcd8202 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1523 microversion: 2.1 time: 0.218917 Jun 30 10:01:24.679926 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 70/132] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:24 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1523 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:24.993747 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-554f0db1-1b32-4954-a9fd-1df311cb4f30 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f5b8292-e4f6-4a43-9bcc-cca58dc75f45"}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:01:24.995272 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-554f0db1-1b32-4954-a9fd-1df311cb4f30 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] [instance: b918deb4-fb3e-4cf4-8057-50802bd5af36] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:25.001903 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-554f0db1-1b32-4954-a9fd-1df311cb4f30 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:25.002338 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-554f0db1-1b32-4954-a9fd-1df311cb4f30 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:25.004305 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-554f0db1-1b32-4954-a9fd-1df311cb4f30 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:25.005214 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-554f0db1-1b32-4954-a9fd-1df311cb4f30 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:25.472833 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-9b7e51df-ede3-4fa1-b734-9bee2cd9465b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:25.474248 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-9b7e51df-ede3-4fa1-b734-9bee2cd9465b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 18a19a8d-e121-4f9d-8906-574d6ecce160] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:25.482647 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9b7e51df-ede3-4fa1-b734-9bee2cd9465b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:25.483217 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9b7e51df-ede3-4fa1-b734-9bee2cd9465b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:25.484065 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9b7e51df-ede3-4fa1-b734-9bee2cd9465b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:25.484515 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9b7e51df-ede3-4fa1-b734-9bee2cd9465b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:25.672909 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-9b7e51df-ede3-4fa1-b734-9bee2cd9465b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:25.685449 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-9b7e51df-ede3-4fa1-b734-9bee2cd9465b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160" status: 200 len: 1557 microversion: 2.1 time: 0.218616 Jun 30 10:01:25.686041 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 71/133] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:25 2022] GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160 => generated 1557 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:25.702253 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-e5d0d8aa-3dd0-4b65-a57f-86f40c4158b5 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:25.702859 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-e5d0d8aa-3dd0-4b65-a57f-86f40c4158b5 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:25.715275 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e5d0d8aa-3dd0-4b65-a57f-86f40c4158b5 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:25.715718 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e5d0d8aa-3dd0-4b65-a57f-86f40c4158b5 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:25.716527 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e5d0d8aa-3dd0-4b65-a57f-86f40c4158b5 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:25.719485 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e5d0d8aa-3dd0-4b65-a57f-86f40c4158b5 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:26.153245 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-e5d0d8aa-3dd0-4b65-a57f-86f40c4158b5 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:26.161756 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-e5d0d8aa-3dd0-4b65-a57f-86f40c4158b5 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:26.163285 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-e5d0d8aa-3dd0-4b65-a57f-86f40c4158b5 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:26.164478 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-e5d0d8aa-3dd0-4b65-a57f-86f40c4158b5 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1600 microversion: 2.20 time: 0.476231 Jun 30 10:01:26.185366 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 72/134] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:01:25 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1600 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:01:26.191991 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-209bcc0e-c7ab-4bf8-8679-431c21d5c3dd tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:26.192684 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-209bcc0e-c7ab-4bf8-8679-431c21d5c3dd tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:26.202638 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-209bcc0e-c7ab-4bf8-8679-431c21d5c3dd tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:26.203343 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-209bcc0e-c7ab-4bf8-8679-431c21d5c3dd tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:26.204887 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-209bcc0e-c7ab-4bf8-8679-431c21d5c3dd tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:26.205503 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-209bcc0e-c7ab-4bf8-8679-431c21d5c3dd tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:26.206929 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-554f0db1-1b32-4954-a9fd-1df311cb4f30 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] 10.222.0.16 "POST /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.212565 Jun 30 10:01:26.222436 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 63/135] 10.222.0.16 () {60 vars in 1322 bytes} [Thu Jun 30 10:01:24 2022] POST /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36/os-volume_attachments => generated 194 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:01:26.230055 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-6b41656a-6f33-4b2e-926b-9a7598fd76fd tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:26.230793 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-6b41656a-6f33-4b2e-926b-9a7598fd76fd tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 18a19a8d-e121-4f9d-8906-574d6ecce160] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:26.238336 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6b41656a-6f33-4b2e-926b-9a7598fd76fd tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:26.239144 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6b41656a-6f33-4b2e-926b-9a7598fd76fd tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:26.240240 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6b41656a-6f33-4b2e-926b-9a7598fd76fd tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:26.240808 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6b41656a-6f33-4b2e-926b-9a7598fd76fd tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:26.454691 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-6b41656a-6f33-4b2e-926b-9a7598fd76fd tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.230045 Jun 30 10:01:26.456081 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 64/136] 10.222.0.16 () {58 vars in 1274 bytes} [Thu Jun 30 10:01:26 2022] GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160/os-interface => generated 284 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:01:26.465962 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-8ef98b0a-c9f3-4ac8-9d5b-fcbcce2cf8f5 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:26.466452 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-8ef98b0a-c9f3-4ac8-9d5b-fcbcce2cf8f5 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:26.475553 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8ef98b0a-c9f3-4ac8-9d5b-fcbcce2cf8f5 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:26.476026 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8ef98b0a-c9f3-4ac8-9d5b-fcbcce2cf8f5 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:26.476790 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8ef98b0a-c9f3-4ac8-9d5b-fcbcce2cf8f5 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:26.479162 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8ef98b0a-c9f3-4ac8-9d5b-fcbcce2cf8f5 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:26.675303 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-8ef98b0a-c9f3-4ac8-9d5b-fcbcce2cf8f5 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.217977 Jun 30 10:01:26.676882 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 65/137] 10.222.0.16 () {60 vars in 1315 bytes} [Thu Jun 30 10:01:26 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d/os-interface => generated 284 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 10:01:26.692217 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-209bcc0e-c7ab-4bf8-8679-431c21d5c3dd tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:26.704816 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-209bcc0e-c7ab-4bf8-8679-431c21d5c3dd tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1523 microversion: 2.1 time: 0.518101 Jun 30 10:01:26.705910 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 73/138] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:26 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1523 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:27.723812 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-91287473-1308-43c8-ac10-86d10b563131 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:27.724459 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-91287473-1308-43c8-ac10-86d10b563131 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:27.731013 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-91287473-1308-43c8-ac10-86d10b563131 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:27.731578 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-91287473-1308-43c8-ac10-86d10b563131 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:27.733010 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-91287473-1308-43c8-ac10-86d10b563131 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:27.733445 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-91287473-1308-43c8-ac10-86d10b563131 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:28.087973 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-91287473-1308-43c8-ac10-86d10b563131 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:28.101555 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-91287473-1308-43c8-ac10-86d10b563131 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1523 microversion: 2.1 time: 0.381782 Jun 30 10:01:28.104723 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 66/139] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:27 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1523 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:28.676386 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [req-213bac1c-011f-48e2-a6d1-c4baa1171c46 req-48579784-bb36-4800-af97-e540086e0926 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18a19a8d-e121-4f9d-8906-574d6ecce160", "tag": "1b857dd1-e79c-49ad-bc35-e8f33b08e271"}]} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:01:28.692113 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_api:SELECT=93 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:01:28.697065 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-213bac1c-011f-48e2-a6d1-c4baa1171c46 req-48579784-bb36-4800-af97-e540086e0926 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:28.697897 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-213bac1c-011f-48e2-a6d1-c4baa1171c46 req-48579784-bb36-4800-af97-e540086e0926 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:28.723256 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.compute.server_external_events [req-213bac1c-011f-48e2-a6d1-c4baa1171c46 req-48579784-bb36-4800-af97-e540086e0926 service nova] Creating event network-changed:1b857dd1-e79c-49ad-bc35-e8f33b08e271 for instance 18a19a8d-e121-4f9d-8906-574d6ecce160 on hv-cinder-84330 Jun 30 10:01:28.733686 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [req-213bac1c-011f-48e2-a6d1-c4baa1171c46 req-48579784-bb36-4800-af97-e540086e0926 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062695 Jun 30 10:01:28.734308 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 74/140] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:01:28.779746 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-a81700a3-ac0f-473e-bb4f-fafce8cab54d req-a43d6483-218d-45c5-9cd1-6a0fdc66a3a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c15c69f-e851-41aa-9f31-0e897b2f302d", "tag": "c1be8ae5-cf30-4b83-be1b-6a94517a895b"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:01:28.795415 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-a81700a3-ac0f-473e-bb4f-fafce8cab54d req-a43d6483-218d-45c5-9cd1-6a0fdc66a3a6 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:28.795914 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-a81700a3-ac0f-473e-bb4f-fafce8cab54d req-a43d6483-218d-45c5-9cd1-6a0fdc66a3a6 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:28.832496 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-a81700a3-ac0f-473e-bb4f-fafce8cab54d req-a43d6483-218d-45c5-9cd1-6a0fdc66a3a6 service nova] Creating event network-changed:c1be8ae5-cf30-4b83-be1b-6a94517a895b for instance 8c15c69f-e851-41aa-9f31-0e897b2f302d on hv-cinder-84330 Jun 30 10:01:28.847995 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-a81700a3-ac0f-473e-bb4f-fafce8cab54d req-a43d6483-218d-45c5-9cd1-6a0fdc66a3a6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071937 Jun 30 10:01:28.850938 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 67/141] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:01:29.121084 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-135336dd-5de4-4b11-8ed7-263150e1d63c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:29.122030 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-135336dd-5de4-4b11-8ed7-263150e1d63c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:29.130725 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-135336dd-5de4-4b11-8ed7-263150e1d63c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:29.133674 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-135336dd-5de4-4b11-8ed7-263150e1d63c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:29.145164 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-135336dd-5de4-4b11-8ed7-263150e1d63c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:29.145859 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-135336dd-5de4-4b11-8ed7-263150e1d63c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:29.938875 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-135336dd-5de4-4b11-8ed7-263150e1d63c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:29.948135 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-135336dd-5de4-4b11-8ed7-263150e1d63c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1523 microversion: 2.1 time: 0.831491 Jun 30 10:01:29.960985 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 75/142] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:29 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1523 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:30.969852 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-817e165c-2068-4abb-872b-0e764f426440 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:30.971481 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-817e165c-2068-4abb-872b-0e764f426440 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:30.986913 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-817e165c-2068-4abb-872b-0e764f426440 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:30.989807 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-817e165c-2068-4abb-872b-0e764f426440 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:30.990850 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-817e165c-2068-4abb-872b-0e764f426440 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:30.991666 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-817e165c-2068-4abb-872b-0e764f426440 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:31.410250 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-817e165c-2068-4abb-872b-0e764f426440 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:31.422043 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-817e165c-2068-4abb-872b-0e764f426440 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1523 microversion: 2.1 time: 0.455336 Jun 30 10:01:31.422043 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 68/143] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:30 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1523 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:32.441105 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-b22f2af8-36ba-4c6b-a5b0-1c1510aa3c5b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:32.442410 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-b22f2af8-36ba-4c6b-a5b0-1c1510aa3c5b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:32.450236 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b22f2af8-36ba-4c6b-a5b0-1c1510aa3c5b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:32.450851 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b22f2af8-36ba-4c6b-a5b0-1c1510aa3c5b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:32.451814 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b22f2af8-36ba-4c6b-a5b0-1c1510aa3c5b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:32.452277 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b22f2af8-36ba-4c6b-a5b0-1c1510aa3c5b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:32.646018 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-b22f2af8-36ba-4c6b-a5b0-1c1510aa3c5b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:32.657061 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-b22f2af8-36ba-4c6b-a5b0-1c1510aa3c5b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1523 microversion: 2.1 time: 0.222400 Jun 30 10:01:32.657789 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 76/144] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:32 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1523 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:33.675546 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-d41136fd-99ef-40aa-a789-f35e7d472d99 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:33.676212 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-d41136fd-99ef-40aa-a789-f35e7d472d99 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:33.685097 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d41136fd-99ef-40aa-a789-f35e7d472d99 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:33.685547 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d41136fd-99ef-40aa-a789-f35e7d472d99 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:33.686322 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d41136fd-99ef-40aa-a789-f35e7d472d99 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:33.686753 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d41136fd-99ef-40aa-a789-f35e7d472d99 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:33.881368 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-d41136fd-99ef-40aa-a789-f35e7d472d99 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:33.889927 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-d41136fd-99ef-40aa-a789-f35e7d472d99 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1523 microversion: 2.1 time: 0.218391 Jun 30 10:01:33.890754 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 69/145] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:33 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1523 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:34.908381 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-6929865e-36b8-4beb-9133-1b2bb9762cd9 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:34.908986 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-6929865e-36b8-4beb-9133-1b2bb9762cd9 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:34.915590 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-6929865e-36b8-4beb-9133-1b2bb9762cd9 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:34.916115 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-6929865e-36b8-4beb-9133-1b2bb9762cd9 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:34.916890 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-6929865e-36b8-4beb-9133-1b2bb9762cd9 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:34.917568 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-6929865e-36b8-4beb-9133-1b2bb9762cd9 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:35.107407 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-6929865e-36b8-4beb-9133-1b2bb9762cd9 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:35.115373 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-6929865e-36b8-4beb-9133-1b2bb9762cd9 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1523 microversion: 2.1 time: 0.210887 Jun 30 10:01:35.115970 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 77/146] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:34 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1523 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:36.137797 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-1149b52e-9f99-4ec8-9370-3b5697acdfb8 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:36.138499 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-1149b52e-9f99-4ec8-9370-3b5697acdfb8 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:36.141845 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=82 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:01:36.147924 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1149b52e-9f99-4ec8-9370-3b5697acdfb8 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:36.148836 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1149b52e-9f99-4ec8-9370-3b5697acdfb8 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:36.149771 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1149b52e-9f99-4ec8-9370-3b5697acdfb8 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:36.150716 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1149b52e-9f99-4ec8-9370-3b5697acdfb8 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:36.352727 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-1149b52e-9f99-4ec8-9370-3b5697acdfb8 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:36.367174 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-1149b52e-9f99-4ec8-9370-3b5697acdfb8 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1523 microversion: 2.1 time: 0.239377 Jun 30 10:01:36.376243 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 70/147] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:36 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1523 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:37.226384 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-02049b5e-06b7-40dc-9eff-d074228ef30d tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:37.227525 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-02049b5e-06b7-40dc-9eff-d074228ef30d tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] [instance: b918deb4-fb3e-4cf4-8057-50802bd5af36] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:37.233954 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-02049b5e-06b7-40dc-9eff-d074228ef30d tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:37.234387 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-02049b5e-06b7-40dc-9eff-d074228ef30d tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:37.235161 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-02049b5e-06b7-40dc-9eff-d074228ef30d tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:37.235581 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-02049b5e-06b7-40dc-9eff-d074228ef30d tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:37.264962 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-02049b5e-06b7-40dc-9eff-d074228ef30d tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] [instance: b918deb4-fb3e-4cf4-8057-50802bd5af36] Going to try to terminate instance {{(pid=117847) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 10:01:37.383835 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-3834bcf0-3fe1-4470-b7f2-0aa12ecae9af tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:37.384567 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-3834bcf0-3fe1-4470-b7f2-0aa12ecae9af tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:37.394832 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3834bcf0-3fe1-4470-b7f2-0aa12ecae9af tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:37.400762 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3834bcf0-3fe1-4470-b7f2-0aa12ecae9af tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:37.402418 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3834bcf0-3fe1-4470-b7f2-0aa12ecae9af tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:37.403059 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3834bcf0-3fe1-4470-b7f2-0aa12ecae9af tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:37.412980 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-02049b5e-06b7-40dc-9eff-d074228ef30d tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36" status: 204 len: 0 microversion: 2.1 time: 0.186001 Jun 30 10:01:37.413707 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 78/148] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 10:01:37 2022] DELETE /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 10:01:37.425688 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-21084016-9ffd-47d1-9342-1b4444532d47 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:37.427035 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-21084016-9ffd-47d1-9342-1b4444532d47 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] [instance: b918deb4-fb3e-4cf4-8057-50802bd5af36] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:37.435133 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-21084016-9ffd-47d1-9342-1b4444532d47 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:37.436135 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-21084016-9ffd-47d1-9342-1b4444532d47 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:37.437293 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-21084016-9ffd-47d1-9342-1b4444532d47 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:37.437862 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-21084016-9ffd-47d1-9342-1b4444532d47 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:37.630919 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-3834bcf0-3fe1-4470-b7f2-0aa12ecae9af tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:37.640547 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-3834bcf0-3fe1-4470-b7f2-0aa12ecae9af tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1523 microversion: 2.1 time: 0.260534 Jun 30 10:01:37.641481 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 71/149] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:37 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1523 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:37.655523 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-21084016-9ffd-47d1-9342-1b4444532d47 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a8708943a94915970a0ff89b9f17e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b1cb0fcef4cbba01134acdba481be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:37.663751 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-21084016-9ffd-47d1-9342-1b4444532d47 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] 10.222.0.16 "GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36" status: 200 len: 1552 microversion: 2.1 time: 0.244352 Jun 30 10:01:37.664332 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 79/150] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:37 2022] GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36 => generated 1552 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:38.656898 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-62a14643-1010-4593-8ed7-9e6e550c98e8 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:38.657503 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-62a14643-1010-4593-8ed7-9e6e550c98e8 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:38.664173 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-62a14643-1010-4593-8ed7-9e6e550c98e8 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:38.664608 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-62a14643-1010-4593-8ed7-9e6e550c98e8 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:38.665374 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-62a14643-1010-4593-8ed7-9e6e550c98e8 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:38.665942 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-62a14643-1010-4593-8ed7-9e6e550c98e8 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:38.681179 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-b68c4fae-2ce0-46f1-9638-881a5c2dcc61 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:38.681861 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-b68c4fae-2ce0-46f1-9638-881a5c2dcc61 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] [instance: b918deb4-fb3e-4cf4-8057-50802bd5af36] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:38.688499 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b68c4fae-2ce0-46f1-9638-881a5c2dcc61 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:38.688932 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b68c4fae-2ce0-46f1-9638-881a5c2dcc61 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:38.689681 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b68c4fae-2ce0-46f1-9638-881a5c2dcc61 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:38.690101 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b68c4fae-2ce0-46f1-9638-881a5c2dcc61 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:38.860514 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-62a14643-1010-4593-8ed7-9e6e550c98e8 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:38.867646 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-b68c4fae-2ce0-46f1-9638-881a5c2dcc61 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a8708943a94915970a0ff89b9f17e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b1cb0fcef4cbba01134acdba481be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:38.868145 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-62a14643-1010-4593-8ed7-9e6e550c98e8 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1523 microversion: 2.1 time: 0.214967 Jun 30 10:01:38.869073 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 72/151] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:38 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1523 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:38.884748 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-b68c4fae-2ce0-46f1-9638-881a5c2dcc61 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] 10.222.0.16 "GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36" status: 200 len: 1552 microversion: 2.1 time: 0.207255 Jun 30 10:01:38.885293 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 80/152] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:38 2022] GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36 => generated 1552 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:01:39.885826 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-01606db4-cf8f-4dc6-a123-15181d0faa01 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:39.886416 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-01606db4-cf8f-4dc6-a123-15181d0faa01 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:39.893228 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-01606db4-cf8f-4dc6-a123-15181d0faa01 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:39.893660 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-01606db4-cf8f-4dc6-a123-15181d0faa01 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:39.894415 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-01606db4-cf8f-4dc6-a123-15181d0faa01 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:39.894835 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-01606db4-cf8f-4dc6-a123-15181d0faa01 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:39.902686 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-31930d8e-73b0-4c09-9464-1b8e1fd8f7e3 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:39.903461 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-31930d8e-73b0-4c09-9464-1b8e1fd8f7e3 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] [instance: b918deb4-fb3e-4cf4-8057-50802bd5af36] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:39.909843 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-31930d8e-73b0-4c09-9464-1b8e1fd8f7e3 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:39.910304 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-31930d8e-73b0-4c09-9464-1b8e1fd8f7e3 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:39.911094 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-31930d8e-73b0-4c09-9464-1b8e1fd8f7e3 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:39.911524 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-31930d8e-73b0-4c09-9464-1b8e1fd8f7e3 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:40.098309 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-01606db4-cf8f-4dc6-a123-15181d0faa01 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:40.102913 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-31930d8e-73b0-4c09-9464-1b8e1fd8f7e3 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a8708943a94915970a0ff89b9f17e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b1cb0fcef4cbba01134acdba481be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:40.106128 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-01606db4-cf8f-4dc6-a123-15181d0faa01 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1523 microversion: 2.1 time: 0.224815 Jun 30 10:01:40.106694 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 73/153] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:39 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1523 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:40.111178 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-31930d8e-73b0-4c09-9464-1b8e1fd8f7e3 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] 10.222.0.16 "GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36" status: 200 len: 1552 microversion: 2.1 time: 0.213270 Jun 30 10:01:40.111791 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 81/154] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:39 2022] GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36 => generated 1552 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:41.122560 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-472a762b-d3db-40f4-b448-b4db775244eb tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:41.128376 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-b99005a2-1ddf-43b1-8a0b-a2c0feb3e22d tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:41.129127 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-472a762b-d3db-40f4-b448-b4db775244eb tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:41.131333 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-b99005a2-1ddf-43b1-8a0b-a2c0feb3e22d tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] [instance: b918deb4-fb3e-4cf4-8057-50802bd5af36] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:41.139903 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b99005a2-1ddf-43b1-8a0b-a2c0feb3e22d tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:41.140326 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b99005a2-1ddf-43b1-8a0b-a2c0feb3e22d tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:41.141104 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b99005a2-1ddf-43b1-8a0b-a2c0feb3e22d tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:41.141243 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-472a762b-d3db-40f4-b448-b4db775244eb tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:41.141526 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b99005a2-1ddf-43b1-8a0b-a2c0feb3e22d tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:41.141665 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-472a762b-d3db-40f4-b448-b4db775244eb tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:41.142571 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-472a762b-d3db-40f4-b448-b4db775244eb tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:41.143010 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-472a762b-d3db-40f4-b448-b4db775244eb tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:41.341757 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-b99005a2-1ddf-43b1-8a0b-a2c0feb3e22d tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a8708943a94915970a0ff89b9f17e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b1cb0fcef4cbba01134acdba481be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:41.351798 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-b99005a2-1ddf-43b1-8a0b-a2c0feb3e22d tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] 10.222.0.16 "GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36" status: 200 len: 1552 microversion: 2.1 time: 0.227296 Jun 30 10:01:41.352452 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 82/155] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:41 2022] GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36 => generated 1552 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:41.356976 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-472a762b-d3db-40f4-b448-b4db775244eb tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:41.365081 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-472a762b-d3db-40f4-b448-b4db775244eb tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1523 microversion: 2.1 time: 0.246440 Jun 30 10:01:41.365637 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 74/156] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:41 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1523 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:42.370318 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-5b6a01bb-11bd-4ce3-b8a1-8813c8389aa5 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:42.370946 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-5b6a01bb-11bd-4ce3-b8a1-8813c8389aa5 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] [instance: b918deb4-fb3e-4cf4-8057-50802bd5af36] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:42.377553 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-5b6a01bb-11bd-4ce3-b8a1-8813c8389aa5 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:42.378112 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-5b6a01bb-11bd-4ce3-b8a1-8813c8389aa5 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:42.379030 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-5b6a01bb-11bd-4ce3-b8a1-8813c8389aa5 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:42.379522 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-5b6a01bb-11bd-4ce3-b8a1-8813c8389aa5 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:42.382529 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-2222aeaf-506f-4743-b676-1fb2facd0eb8 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:42.383137 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-2222aeaf-506f-4743-b676-1fb2facd0eb8 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:42.389957 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2222aeaf-506f-4743-b676-1fb2facd0eb8 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:42.390361 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2222aeaf-506f-4743-b676-1fb2facd0eb8 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:42.391305 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2222aeaf-506f-4743-b676-1fb2facd0eb8 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:42.391906 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2222aeaf-506f-4743-b676-1fb2facd0eb8 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:42.575022 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-5b6a01bb-11bd-4ce3-b8a1-8813c8389aa5 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a8708943a94915970a0ff89b9f17e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b1cb0fcef4cbba01134acdba481be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:42.586224 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-2222aeaf-506f-4743-b676-1fb2facd0eb8 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:42.589625 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-5b6a01bb-11bd-4ce3-b8a1-8813c8389aa5 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] 10.222.0.16 "GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36" status: 200 len: 1552 microversion: 2.1 time: 0.224133 Jun 30 10:01:42.590226 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 83/157] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:42 2022] GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36 => generated 1552 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:42.594208 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-2222aeaf-506f-4743-b676-1fb2facd0eb8 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1523 microversion: 2.1 time: 0.215739 Jun 30 10:01:42.594832 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 75/158] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:42 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1523 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:43.606647 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-9bcef90b-5001-49c9-8a58-0927b35ba8ee tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:43.607264 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-9bcef90b-5001-49c9-8a58-0927b35ba8ee tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] [instance: b918deb4-fb3e-4cf4-8057-50802bd5af36] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:43.613513 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e4b9e6af-d861-45c3-a2ce-9fbd160e6c24 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:43.613513 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-e4b9e6af-d861-45c3-a2ce-9fbd160e6c24 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:43.614553 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9bcef90b-5001-49c9-8a58-0927b35ba8ee tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:43.615067 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9bcef90b-5001-49c9-8a58-0927b35ba8ee tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:43.615738 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9bcef90b-5001-49c9-8a58-0927b35ba8ee tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:43.616186 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9bcef90b-5001-49c9-8a58-0927b35ba8ee tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:43.618144 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e4b9e6af-d861-45c3-a2ce-9fbd160e6c24 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:43.618631 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e4b9e6af-d861-45c3-a2ce-9fbd160e6c24 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:43.619788 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e4b9e6af-d861-45c3-a2ce-9fbd160e6c24 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:43.620257 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e4b9e6af-d861-45c3-a2ce-9fbd160e6c24 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:43.635746 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:01:43.812480 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-9bcef90b-5001-49c9-8a58-0927b35ba8ee tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a8708943a94915970a0ff89b9f17e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b1cb0fcef4cbba01134acdba481be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:43.819608 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e4b9e6af-d861-45c3-a2ce-9fbd160e6c24 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:43.822681 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-9bcef90b-5001-49c9-8a58-0927b35ba8ee tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] 10.222.0.16 "GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36" status: 200 len: 1552 microversion: 2.1 time: 0.219863 Jun 30 10:01:43.823460 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 84/159] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:43 2022] GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36 => generated 1552 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:43.828387 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-e4b9e6af-d861-45c3-a2ce-9fbd160e6c24 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1523 microversion: 2.1 time: 0.221323 Jun 30 10:01:43.829172 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 76/160] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:43 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1523 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:44.692038 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [req-d4fd8d02-b170-47f0-b532-320d07627d7a req-525fc898-a405-477d-b71f-e046ac30e82d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b918deb4-fb3e-4cf4-8057-50802bd5af36", "name": "network-vif-deleted", "tag": "f392866f-edc8-4026-8404-36345b63925a"}]} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:01:44.702502 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-d4fd8d02-b170-47f0-b532-320d07627d7a req-525fc898-a405-477d-b71f-e046ac30e82d service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:44.703110 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-d4fd8d02-b170-47f0-b532-320d07627d7a req-525fc898-a405-477d-b71f-e046ac30e82d service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:44.728282 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.compute.server_external_events [req-d4fd8d02-b170-47f0-b532-320d07627d7a req-525fc898-a405-477d-b71f-e046ac30e82d service nova] Creating event network-vif-deleted:f392866f-edc8-4026-8404-36345b63925a for instance b918deb4-fb3e-4cf4-8057-50802bd5af36 on hv-cinder-84330 Jun 30 10:01:44.735520 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [req-d4fd8d02-b170-47f0-b532-320d07627d7a req-525fc898-a405-477d-b71f-e046ac30e82d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045976 Jun 30 10:01:44.736311 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 85/161] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:01:44.840641 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-6067d9eb-7b61-4f9a-b21e-f89297c98596 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:44.841252 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-6067d9eb-7b61-4f9a-b21e-f89297c98596 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] [instance: b918deb4-fb3e-4cf4-8057-50802bd5af36] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:44.844975 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-9a5bb44c-fe5d-434a-bf5b-c5689d6363ce tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:44.845672 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-9a5bb44c-fe5d-434a-bf5b-c5689d6363ce tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:44.848087 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6067d9eb-7b61-4f9a-b21e-f89297c98596 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:44.848521 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6067d9eb-7b61-4f9a-b21e-f89297c98596 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:44.849279 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6067d9eb-7b61-4f9a-b21e-f89297c98596 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:44.849723 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6067d9eb-7b61-4f9a-b21e-f89297c98596 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:44.852822 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9a5bb44c-fe5d-434a-bf5b-c5689d6363ce tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:44.853594 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9a5bb44c-fe5d-434a-bf5b-c5689d6363ce tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:44.854649 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9a5bb44c-fe5d-434a-bf5b-c5689d6363ce tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:44.855120 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9a5bb44c-fe5d-434a-bf5b-c5689d6363ce tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:44.924927 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-6067d9eb-7b61-4f9a-b21e-f89297c98596 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a8708943a94915970a0ff89b9f17e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b1cb0fcef4cbba01134acdba481be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:44.928451 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:01:44.934295 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-6067d9eb-7b61-4f9a-b21e-f89297c98596 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] 10.222.0.16 "GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36" status: 200 len: 1345 microversion: 2.1 time: 0.097982 Jun 30 10:01:44.934838 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 77/162] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:44 2022] GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36 => generated 1345 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:45.023968 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-9a5bb44c-fe5d-434a-bf5b-c5689d6363ce tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:45.032353 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-9a5bb44c-fe5d-434a-bf5b-c5689d6363ce tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1523 microversion: 2.1 time: 0.191571 Jun 30 10:01:45.033051 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 86/163] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:44 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:01:45.952449 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-5b2073fc-6d82-4d53-aa96-d3b7e33c889d tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:45.953190 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-5b2073fc-6d82-4d53-aa96-d3b7e33c889d tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] [instance: b918deb4-fb3e-4cf4-8057-50802bd5af36] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:45.966166 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5b2073fc-6d82-4d53-aa96-d3b7e33c889d tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:45.966916 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5b2073fc-6d82-4d53-aa96-d3b7e33c889d tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:45.967925 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5b2073fc-6d82-4d53-aa96-d3b7e33c889d tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:45.968449 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5b2073fc-6d82-4d53-aa96-d3b7e33c889d tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:46.000825 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-5b2073fc-6d82-4d53-aa96-d3b7e33c889d tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] HTTP exception thrown: Instance b918deb4-fb3e-4cf4-8057-50802bd5af36 could not be found. Jun 30 10:01:46.005837 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-5b2073fc-6d82-4d53-aa96-d3b7e33c889d tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Request method failure captured: Jun 30 10:01:46.005837 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: request: GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36 HTTP/1.1 Jun 30 10:01:46.005837 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept: application/json Jun 30 10:01:46.005837 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jun 30 10:01:46.005837 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Connection: close Jun 30 10:01:46.005837 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jun 30 10:01:46.005837 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jun 30 10:01:46.005837 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Host: 10.222.0.16 Jun 30 10:01:46.005837 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jun 30 10:01:46.005837 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jun 30 10:01:46.005837 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABivXRGz6sNNIvpHrt-WnbchnQpXAyM_J-AATi8aMFPrAS01d1YL9gVrdFsWd1J0OWwlYTLRVzscjyYt7VER2mqjVuDxVHNLbh_wGz0i07YdyI5ThLEVxZ0Wuz95Hvvyad3btOLFqd591zIHuSuDOSsypl0LTejZ0h3ucTzkXpjHFS_Wu4 Jun 30 10:01:46.005837 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jun 30 10:01:46.005837 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jun 30 10:01:46.005837 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jun 30 10:01:46.005837 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jun 30 10:01:46.005837 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jun 30 10:01:46.005837 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jun 30 10:01:46.005837 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Id: c06b1cb0fcef4cbba01134acdba481be Jun 30 10:01:46.005837 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-DeleteServersTestJSON-1464973945 Jun 30 10:01:46.005837 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Role: reader,member Jun 30 10:01:46.005837 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Roles: reader,member Jun 30 10:01:46.007311 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c06b1cb0fcef4cbba01134acdba481be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c06b1cb0fcef4cbba01134acdba481be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c06b1cb0fcef4cbba01134acdba481be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c06b1cb0fcef4cbba01134acdba481be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:01:46.007311 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-DeleteServersTestJSON-1464973945 Jun 30 10:01:46.007311 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Id: c06b1cb0fcef4cbba01134acdba481be Jun 30 10:01:46.007311 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-DeleteServersTestJSON-1464973945 Jun 30 10:01:46.007311 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User: tempest-DeleteServersTestJSON-1464973945-project Jun 30 10:01:46.007311 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jun 30 10:01:46.007311 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jun 30 10:01:46.007311 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Id: b7a8708943a94915970a0ff89b9f17e3 Jun 30 10:01:46.007311 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-DeleteServersTestJSON-1464973945-project Jun 30 10:01:46.007311 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: method: > Jun 30 10:01:46.007311 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: exception: Instance b918deb4-fb3e-4cf4-8057-50802bd5af36 could not be found. Jun 30 10:01:46.007311 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: action_args: {'id': 'b918deb4-fb3e-4cf4-8057-50802bd5af36'} Jun 30 10:01:46.008525 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:01:46.008525 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:01:46.008525 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:01:46.008525 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:01:46.008525 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:01:46.008525 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:01:46.008525 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:01:46.008525 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:01:46.008525 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:01:46.008525 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:01:46.008525 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b918deb4-fb3e-4cf4-8057-50802bd5af36 could not be found. Jun 30 10:01:46.008525 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:01:46.008525 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:01:46.008525 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:01:46.008525 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:01:46.008525 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:01:46.008525 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:01:46.008525 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:01:46.008525 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:01:46.008525 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:01:46.009925 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:01:46.009925 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:01:46.009925 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:01:46.009925 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:01:46.009925 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:01:46.009925 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:01:46.009925 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:01:46.009925 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b918deb4-fb3e-4cf4-8057-50802bd5af36 could not be found. Jun 30 10:01:46.009925 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:01:46.009925 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:01:46.009925 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:01:46.009925 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:01:46.009925 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:01:46.009925 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:01:46.009925 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:01:46.009925 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:01:46.009925 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b918deb4-fb3e-4cf4-8057-50802bd5af36 could not be found. Jun 30 10:01:46.009925 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:01:46.011313 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-5b2073fc-6d82-4d53-aa96-d3b7e33c889d tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Returning 404 to user: Instance b918deb4-fb3e-4cf4-8057-50802bd5af36 could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:01:46.011313 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-5b2073fc-6d82-4d53-aa96-d3b7e33c889d tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] 10.222.0.16 "GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36" status: 404 len: 111 microversion: 2.1 time: 0.059458 Jun 30 10:01:46.011313 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 78/164] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:45 2022] GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:01:46.050667 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-9619e595-5716-40bf-a79f-b19a674a15ed tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:46.051276 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-9619e595-5716-40bf-a79f-b19a674a15ed tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:46.058600 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9619e595-5716-40bf-a79f-b19a674a15ed tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:46.059346 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9619e595-5716-40bf-a79f-b19a674a15ed tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:46.060622 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9619e595-5716-40bf-a79f-b19a674a15ed tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:46.061195 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9619e595-5716-40bf-a79f-b19a674a15ed tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:46.155397 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-3436560c-cb1f-4f62-bb9c-1ea8b573060a tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:46.156346 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-3436560c-cb1f-4f62-bb9c-1ea8b573060a tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] [instance: b918deb4-fb3e-4cf4-8057-50802bd5af36] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:46.172594 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3436560c-cb1f-4f62-bb9c-1ea8b573060a tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:46.173343 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3436560c-cb1f-4f62-bb9c-1ea8b573060a tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:46.174623 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3436560c-cb1f-4f62-bb9c-1ea8b573060a tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:46.175199 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3436560c-cb1f-4f62-bb9c-1ea8b573060a tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:46.191395 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-3436560c-cb1f-4f62-bb9c-1ea8b573060a tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] HTTP exception thrown: Instance b918deb4-fb3e-4cf4-8057-50802bd5af36 could not be found. Jun 30 10:01:46.193340 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-3436560c-cb1f-4f62-bb9c-1ea8b573060a tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Request method failure captured: Jun 30 10:01:46.193340 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: request: GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36/os-volume_attachments HTTP/1.1 Jun 30 10:01:46.193340 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept: application/json Jun 30 10:01:46.193340 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jun 30 10:01:46.193340 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Connection: close Jun 30 10:01:46.193340 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jun 30 10:01:46.193340 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jun 30 10:01:46.193340 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Host: 10.222.0.16 Jun 30 10:01:46.193340 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jun 30 10:01:46.193340 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jun 30 10:01:46.193340 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABivXRGz6sNNIvpHrt-WnbchnQpXAyM_J-AATi8aMFPrAS01d1YL9gVrdFsWd1J0OWwlYTLRVzscjyYt7VER2mqjVuDxVHNLbh_wGz0i07YdyI5ThLEVxZ0Wuz95Hvvyad3btOLFqd591zIHuSuDOSsypl0LTejZ0h3ucTzkXpjHFS_Wu4 Jun 30 10:01:46.193340 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jun 30 10:01:46.193340 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jun 30 10:01:46.193340 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jun 30 10:01:46.193340 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jun 30 10:01:46.193340 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jun 30 10:01:46.193340 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jun 30 10:01:46.193340 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Id: c06b1cb0fcef4cbba01134acdba481be Jun 30 10:01:46.193340 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-DeleteServersTestJSON-1464973945 Jun 30 10:01:46.193340 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Role: reader,member Jun 30 10:01:46.193340 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Roles: reader,member Jun 30 10:01:46.195090 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c06b1cb0fcef4cbba01134acdba481be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c06b1cb0fcef4cbba01134acdba481be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c06b1cb0fcef4cbba01134acdba481be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c06b1cb0fcef4cbba01134acdba481be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:01:46.195090 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-DeleteServersTestJSON-1464973945 Jun 30 10:01:46.195090 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Id: c06b1cb0fcef4cbba01134acdba481be Jun 30 10:01:46.195090 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-DeleteServersTestJSON-1464973945 Jun 30 10:01:46.195090 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User: tempest-DeleteServersTestJSON-1464973945-project Jun 30 10:01:46.195090 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jun 30 10:01:46.195090 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jun 30 10:01:46.195090 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Id: b7a8708943a94915970a0ff89b9f17e3 Jun 30 10:01:46.195090 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-DeleteServersTestJSON-1464973945-project Jun 30 10:01:46.195090 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: method: > Jun 30 10:01:46.195090 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: exception: Instance b918deb4-fb3e-4cf4-8057-50802bd5af36 could not be found. Jun 30 10:01:46.195090 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: action_args: {'server_id': 'b918deb4-fb3e-4cf4-8057-50802bd5af36'} Jun 30 10:01:46.196043 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:01:46.196043 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:01:46.196043 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:01:46.196043 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:01:46.196043 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:01:46.196043 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:01:46.196043 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:01:46.196043 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:01:46.196043 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:01:46.196043 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:01:46.196043 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b918deb4-fb3e-4cf4-8057-50802bd5af36 could not be found. Jun 30 10:01:46.196043 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:01:46.196043 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:01:46.196043 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:01:46.196043 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:01:46.196043 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:01:46.196043 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:01:46.196043 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:01:46.196043 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:01:46.196043 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:01:46.197386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:01:46.197386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 30 10:01:46.197386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 10:01:46.197386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 30 10:01:46.197386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 10:01:46.197386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 30 10:01:46.197386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 30 10:01:46.197386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:01:46.197386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:01:46.197386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b918deb4-fb3e-4cf4-8057-50802bd5af36 could not be found. Jun 30 10:01:46.197386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:01:46.197386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:01:46.197386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:01:46.197386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:01:46.197386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:01:46.197386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:01:46.197386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:01:46.197386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:01:46.197386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b918deb4-fb3e-4cf4-8057-50802bd5af36 could not be found. Jun 30 10:01:46.197386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:01:46.201695 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-3436560c-cb1f-4f62-bb9c-1ea8b573060a tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Returning 404 to user: Instance b918deb4-fb3e-4cf4-8057-50802bd5af36 could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:01:46.201695 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-3436560c-cb1f-4f62-bb9c-1ea8b573060a tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] 10.222.0.16 "GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.045300 Jun 30 10:01:46.201695 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 79/165] 10.222.0.16 () {58 vars in 1301 bytes} [Thu Jun 30 10:01:46 2022] GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36/os-volume_attachments => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:01:46.230170 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-9619e595-5716-40bf-a79f-b19a674a15ed tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:46.238769 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-9619e595-5716-40bf-a79f-b19a674a15ed tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1523 microversion: 2.1 time: 0.192628 Jun 30 10:01:46.240456 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 87/166] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:46 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1523 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:47.257360 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-8fc7f66a-fc0e-4cfa-9964-c9d4b7ed94cb tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:47.258719 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-8fc7f66a-fc0e-4cfa-9964-c9d4b7ed94cb tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:47.265478 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8fc7f66a-fc0e-4cfa-9964-c9d4b7ed94cb tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:47.265923 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8fc7f66a-fc0e-4cfa-9964-c9d4b7ed94cb tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:47.266673 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8fc7f66a-fc0e-4cfa-9964-c9d4b7ed94cb tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:47.267125 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8fc7f66a-fc0e-4cfa-9964-c9d4b7ed94cb tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:47.437437 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-8b2b0220-e414-4588-95d3-f1db569946a5 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:47.438614 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-8b2b0220-e414-4588-95d3-f1db569946a5 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] [instance: b918deb4-fb3e-4cf4-8057-50802bd5af36] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:47.445996 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8b2b0220-e414-4588-95d3-f1db569946a5 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:47.446736 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8b2b0220-e414-4588-95d3-f1db569946a5 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:47.447713 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8b2b0220-e414-4588-95d3-f1db569946a5 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:47.448142 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8b2b0220-e414-4588-95d3-f1db569946a5 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:47.458271 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-8fc7f66a-fc0e-4cfa-9964-c9d4b7ed94cb tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:47.462621 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.wsgi [None req-8b2b0220-e414-4588-95d3-f1db569946a5 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] HTTP exception thrown: Instance b918deb4-fb3e-4cf4-8057-50802bd5af36 could not be found. Jun 30 10:01:47.467331 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-8b2b0220-e414-4588-95d3-f1db569946a5 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Request method failure captured: Jun 30 10:01:47.467331 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: request: DELETE /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36 HTTP/1.1 Jun 30 10:01:47.467331 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept: application/json Jun 30 10:01:47.467331 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept-Encoding: identity Jun 30 10:01:47.467331 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Connection: close Jun 30 10:01:47.467331 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Length: 0 Jun 30 10:01:47.467331 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Type: application/json Jun 30 10:01:47.467331 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Host: 10.222.0.16 Jun 30 10:01:47.467331 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Openstack-System-Scope: None Jun 30 10:01:47.467331 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: User-Agent: python-urllib3/1.26.9 Jun 30 10:01:47.467331 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Auth-Token: gAAAAABivXRGz6sNNIvpHrt-WnbchnQpXAyM_J-AATi8aMFPrAS01d1YL9gVrdFsWd1J0OWwlYTLRVzscjyYt7VER2mqjVuDxVHNLbh_wGz0i07YdyI5ThLEVxZ0Wuz95Hvvyad3btOLFqd591zIHuSuDOSsypl0LTejZ0h3ucTzkXpjHFS_Wu4 Jun 30 10:01:47.467331 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Id: None Jun 30 10:01:47.467331 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Name: None Jun 30 10:01:47.467331 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Identity-Status: Confirmed Jun 30 10:01:47.467331 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Is-Admin-Project: True Jun 30 10:01:47.467331 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Id: default Jun 30 10:01:47.467331 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Name: Default Jun 30 10:01:47.467331 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Id: c06b1cb0fcef4cbba01134acdba481be Jun 30 10:01:47.467331 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Name: tempest-DeleteServersTestJSON-1464973945 Jun 30 10:01:47.467331 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Role: reader,member Jun 30 10:01:47.467331 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Roles: reader,member Jun 30 10:01:47.468531 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c06b1cb0fcef4cbba01134acdba481be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c06b1cb0fcef4cbba01134acdba481be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c06b1cb0fcef4cbba01134acdba481be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c06b1cb0fcef4cbba01134acdba481be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:01:47.468531 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant: tempest-DeleteServersTestJSON-1464973945 Jun 30 10:01:47.468531 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Id: c06b1cb0fcef4cbba01134acdba481be Jun 30 10:01:47.468531 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Name: tempest-DeleteServersTestJSON-1464973945 Jun 30 10:01:47.468531 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User: tempest-DeleteServersTestJSON-1464973945-project Jun 30 10:01:47.468531 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Id: default Jun 30 10:01:47.468531 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Name: Default Jun 30 10:01:47.468531 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Id: b7a8708943a94915970a0ff89b9f17e3 Jun 30 10:01:47.468531 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Name: tempest-DeleteServersTestJSON-1464973945-project Jun 30 10:01:47.468531 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: method: > Jun 30 10:01:47.468531 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: exception: Instance b918deb4-fb3e-4cf4-8057-50802bd5af36 could not be found. Jun 30 10:01:47.468531 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: action_args: {'id': 'b918deb4-fb3e-4cf4-8057-50802bd5af36'} Jun 30 10:01:47.469176 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:01:47.469176 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:01:47.469176 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:01:47.469176 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:01:47.469176 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:01:47.469176 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:01:47.469176 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:01:47.469176 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:01:47.469176 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:01:47.469176 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:01:47.469176 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b918deb4-fb3e-4cf4-8057-50802bd5af36 could not be found. Jun 30 10:01:47.469176 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:01:47.469176 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:01:47.469176 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:01:47.469176 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:01:47.469176 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:01:47.469176 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:01:47.469176 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:01:47.469176 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:01:47.469176 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:01:47.470665 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:01:47.470665 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 10:01:47.470665 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 10:01:47.470665 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 10:01:47.470665 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 10:01:47.470665 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:01:47.470665 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:01:47.470665 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:01:47.470665 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:01:47.470665 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b918deb4-fb3e-4cf4-8057-50802bd5af36 could not be found. Jun 30 10:01:47.470665 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:01:47.470665 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:01:47.470665 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:01:47.470665 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:01:47.470665 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:01:47.470665 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:01:47.470665 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:01:47.470665 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:01:47.470665 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b918deb4-fb3e-4cf4-8057-50802bd5af36 could not be found. Jun 30 10:01:47.470665 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:01:47.471946 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-8b2b0220-e414-4588-95d3-f1db569946a5 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Returning 404 to user: Instance b918deb4-fb3e-4cf4-8057-50802bd5af36 could not be found. {{(pid=117847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:01:47.471946 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-8b2b0220-e414-4588-95d3-f1db569946a5 tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36" status: 404 len: 111 microversion: 2.1 time: 0.036796 Jun 30 10:01:47.471946 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 88/167] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 10:01:47 2022] DELETE /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 30 10:01:47.478328 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-f255763d-89c5-4e40-b333-24ddbca94a8e tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:47.479022 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-8fc7f66a-fc0e-4cfa-9964-c9d4b7ed94cb tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1523 microversion: 2.1 time: 0.225240 Jun 30 10:01:47.479235 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-f255763d-89c5-4e40-b333-24ddbca94a8e tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] [instance: b918deb4-fb3e-4cf4-8057-50802bd5af36] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:47.479884 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 80/168] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:47 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1523 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:47.485829 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-f255763d-89c5-4e40-b333-24ddbca94a8e tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:47.486210 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-f255763d-89c5-4e40-b333-24ddbca94a8e tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:47.487001 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-f255763d-89c5-4e40-b333-24ddbca94a8e tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:47.487446 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-f255763d-89c5-4e40-b333-24ddbca94a8e tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:47.508541 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.wsgi [None req-f255763d-89c5-4e40-b333-24ddbca94a8e tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] HTTP exception thrown: Instance b918deb4-fb3e-4cf4-8057-50802bd5af36 could not be found. Jun 30 10:01:47.510634 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-f255763d-89c5-4e40-b333-24ddbca94a8e tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Request method failure captured: Jun 30 10:01:47.510634 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: request: GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36 HTTP/1.1 Jun 30 10:01:47.510634 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept: application/json Jun 30 10:01:47.510634 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept-Encoding: identity Jun 30 10:01:47.510634 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Connection: close Jun 30 10:01:47.510634 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Length: 0 Jun 30 10:01:47.510634 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Type: application/json Jun 30 10:01:47.510634 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Host: 10.222.0.16 Jun 30 10:01:47.510634 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Openstack-System-Scope: None Jun 30 10:01:47.510634 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: User-Agent: python-urllib3/1.26.9 Jun 30 10:01:47.510634 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Auth-Token: gAAAAABivXRGz6sNNIvpHrt-WnbchnQpXAyM_J-AATi8aMFPrAS01d1YL9gVrdFsWd1J0OWwlYTLRVzscjyYt7VER2mqjVuDxVHNLbh_wGz0i07YdyI5ThLEVxZ0Wuz95Hvvyad3btOLFqd591zIHuSuDOSsypl0LTejZ0h3ucTzkXpjHFS_Wu4 Jun 30 10:01:47.510634 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Id: None Jun 30 10:01:47.510634 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Name: None Jun 30 10:01:47.510634 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Identity-Status: Confirmed Jun 30 10:01:47.510634 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Is-Admin-Project: True Jun 30 10:01:47.510634 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Id: default Jun 30 10:01:47.510634 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Name: Default Jun 30 10:01:47.510634 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Id: c06b1cb0fcef4cbba01134acdba481be Jun 30 10:01:47.510634 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Name: tempest-DeleteServersTestJSON-1464973945 Jun 30 10:01:47.510634 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Role: reader,member Jun 30 10:01:47.510634 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Roles: reader,member Jun 30 10:01:47.511755 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c06b1cb0fcef4cbba01134acdba481be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c06b1cb0fcef4cbba01134acdba481be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c06b1cb0fcef4cbba01134acdba481be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c06b1cb0fcef4cbba01134acdba481be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:01:47.511755 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant: tempest-DeleteServersTestJSON-1464973945 Jun 30 10:01:47.511755 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Id: c06b1cb0fcef4cbba01134acdba481be Jun 30 10:01:47.511755 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Name: tempest-DeleteServersTestJSON-1464973945 Jun 30 10:01:47.511755 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User: tempest-DeleteServersTestJSON-1464973945-project Jun 30 10:01:47.511755 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Id: default Jun 30 10:01:47.511755 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Name: Default Jun 30 10:01:47.511755 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Id: b7a8708943a94915970a0ff89b9f17e3 Jun 30 10:01:47.511755 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Name: tempest-DeleteServersTestJSON-1464973945-project Jun 30 10:01:47.511755 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: method: > Jun 30 10:01:47.511755 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: exception: Instance b918deb4-fb3e-4cf4-8057-50802bd5af36 could not be found. Jun 30 10:01:47.511755 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: action_args: {'id': 'b918deb4-fb3e-4cf4-8057-50802bd5af36'} Jun 30 10:01:47.512440 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:01:47.512440 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:01:47.512440 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:01:47.512440 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:01:47.512440 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:01:47.512440 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:01:47.512440 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:01:47.512440 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:01:47.512440 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:01:47.512440 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:01:47.512440 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b918deb4-fb3e-4cf4-8057-50802bd5af36 could not be found. Jun 30 10:01:47.512440 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:01:47.512440 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:01:47.512440 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:01:47.512440 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:01:47.512440 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:01:47.512440 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:01:47.512440 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:01:47.512440 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:01:47.512440 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:01:47.513468 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:01:47.513468 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:01:47.513468 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:01:47.513468 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:01:47.513468 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:01:47.513468 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:01:47.513468 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:01:47.513468 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b918deb4-fb3e-4cf4-8057-50802bd5af36 could not be found. Jun 30 10:01:47.513468 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:01:47.513468 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:01:47.513468 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:01:47.513468 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:01:47.513468 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:01:47.513468 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:01:47.513468 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:01:47.513468 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:01:47.513468 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b918deb4-fb3e-4cf4-8057-50802bd5af36 could not be found. Jun 30 10:01:47.513468 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:01:47.514425 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-f255763d-89c5-4e40-b333-24ddbca94a8e tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] Returning 404 to user: Instance b918deb4-fb3e-4cf4-8057-50802bd5af36 could not be found. {{(pid=117847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:01:47.514425 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-f255763d-89c5-4e40-b333-24ddbca94a8e tempest-DeleteServersTestJSON-1464973945 tempest-DeleteServersTestJSON-1464973945-project] 10.222.0.16 "GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36" status: 404 len: 111 microversion: 2.1 time: 0.038536 Jun 30 10:01:47.514425 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 89/169] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:47 2022] GET /compute/v2.1/servers/b918deb4-fb3e-4cf4-8057-50802bd5af36 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:01:48.500046 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-4d1606fe-8851-4add-807a-b01f033a515f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:48.501800 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-4d1606fe-8851-4add-807a-b01f033a515f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:48.511613 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4d1606fe-8851-4add-807a-b01f033a515f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:48.512308 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4d1606fe-8851-4add-807a-b01f033a515f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:48.513553 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4d1606fe-8851-4add-807a-b01f033a515f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:48.514233 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4d1606fe-8851-4add-807a-b01f033a515f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:48.753992 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-4d1606fe-8851-4add-807a-b01f033a515f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:48.765479 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-4d1606fe-8851-4add-807a-b01f033a515f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1523 microversion: 2.1 time: 0.272889 Jun 30 10:01:48.766201 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 81/170] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:48 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1523 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:49.783720 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-d466d9e9-c0f6-4122-a2ad-601ee2f51144 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:49.784491 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-d466d9e9-c0f6-4122-a2ad-601ee2f51144 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:49.797940 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d466d9e9-c0f6-4122-a2ad-601ee2f51144 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:49.798387 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d466d9e9-c0f6-4122-a2ad-601ee2f51144 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:49.800454 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d466d9e9-c0f6-4122-a2ad-601ee2f51144 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:49.802419 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d466d9e9-c0f6-4122-a2ad-601ee2f51144 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:50.104419 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-d466d9e9-c0f6-4122-a2ad-601ee2f51144 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:50.112706 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-d466d9e9-c0f6-4122-a2ad-601ee2f51144 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1523 microversion: 2.1 time: 0.334095 Jun 30 10:01:50.113659 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 90/171] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:49 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1523 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:51.131670 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-bdb88cbb-e67c-4304-9cc5-ec9ebd81f719 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:51.138695 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-bdb88cbb-e67c-4304-9cc5-ec9ebd81f719 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:51.145632 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bdb88cbb-e67c-4304-9cc5-ec9ebd81f719 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:51.146077 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bdb88cbb-e67c-4304-9cc5-ec9ebd81f719 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:51.146923 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bdb88cbb-e67c-4304-9cc5-ec9ebd81f719 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:51.147330 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bdb88cbb-e67c-4304-9cc5-ec9ebd81f719 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:51.368601 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-99b32d1f-c3c3-419e-933d-e3730992528d tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-247960506", "imageRef": "c9dccba6-70d7-4aa8-9b8f-9c88ef1af443", "flavorRef": "452", "networks": [{"uuid": "e1d0fb6e-ee6c-4ba0-b1f4-8ddcc62634ab"}]}} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:01:51.427927 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.network.neutron [None req-99b32d1f-c3c3-419e-933d-e3730992528d tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] validate_networks() for [('e1d0fb6e-ee6c-4ba0-b1f4-8ddcc62634ab', None, None, None, None, None)] {{(pid=117847) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 10:01:51.653868 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-bdb88cbb-e67c-4304-9cc5-ec9ebd81f719 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:51.664376 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-bdb88cbb-e67c-4304-9cc5-ec9ebd81f719 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1523 microversion: 2.1 time: 0.536568 Jun 30 10:01:51.666520 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 82/172] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:51 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1523 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:52.000517 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-99b32d1f-c3c3-419e-933d-e3730992528d tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Flavor limits 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 10:01:52.001123 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-99b32d1f-c3c3-419e-933d-e3730992528d tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Image limits 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 10:01:52.001737 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-99b32d1f-c3c3-419e-933d-e3730992528d tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Flavor pref 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 10:01:52.002635 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-99b32d1f-c3c3-419e-933d-e3730992528d tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Image pref 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 10:01:52.003443 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-99b32d1f-c3c3-419e-933d-e3730992528d tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 10:01:52.018592 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-99b32d1f-c3c3-419e-933d-e3730992528d tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:52.019375 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-99b32d1f-c3c3-419e-933d-e3730992528d tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:52.021057 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-99b32d1f-c3c3-419e-933d-e3730992528d tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:52.022248 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-99b32d1f-c3c3-419e-933d-e3730992528d tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:52.051416 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.quota [None req-99b32d1f-c3c3-419e-933d-e3730992528d tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Getting quotas for project 46ae600a17f9437d9e62475696c106ca. Resources: {'ram', 'instances', 'cores'} {{(pid=117847) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:01:52.057259 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.quota [None req-99b32d1f-c3c3-419e-933d-e3730992528d tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Getting quotas for user 64fe0b9043ad479284163d04a90b842f and project 46ae600a17f9437d9e62475696c106ca. Resources: {'ram', 'instances', 'cores'} {{(pid=117847) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:01:52.071008 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-99b32d1f-c3c3-419e-933d-e3730992528d tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Going to run 1 instances... {{(pid=117847) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 10:01:52.073625 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-99b32d1f-c3c3-419e-933d-e3730992528d tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] [instance: 824b275d-6e49-45e7-b792-ec245f21a2dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9dccba6-70d7-4aa8-9b8f-9c88ef1af443',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117847) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 10:01:52.132606 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-99b32d1f-c3c3-419e-933d-e3730992528d tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.767933 Jun 30 10:01:52.133775 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 91/173] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jun 30 10:01:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 10:01:52.148044 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-151508b8-05ec-4e64-8cac-cc780e61fd32 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:52.149965 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-151508b8-05ec-4e64-8cac-cc780e61fd32 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] [instance: 824b275d-6e49-45e7-b792-ec245f21a2dd] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:52.226034 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-151508b8-05ec-4e64-8cac-cc780e61fd32 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fe0b9043ad479284163d04a90b842f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae600a17f9437d9e62475696c106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:52.233281 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-151508b8-05ec-4e64-8cac-cc780e61fd32 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] 10.222.0.16 "GET /compute/v2.1/servers/824b275d-6e49-45e7-b792-ec245f21a2dd" status: 200 len: 1213 microversion: 2.1 time: 0.092024 Jun 30 10:01:52.234238 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 83/174] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:52 2022] GET /compute/v2.1/servers/824b275d-6e49-45e7-b792-ec245f21a2dd => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:52.682793 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-9c72ec3d-b4a1-4615-b2ed-829a435fa353 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:52.687503 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-9c72ec3d-b4a1-4615-b2ed-829a435fa353 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:52.694143 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9c72ec3d-b4a1-4615-b2ed-829a435fa353 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:52.695192 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9c72ec3d-b4a1-4615-b2ed-829a435fa353 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:52.696445 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9c72ec3d-b4a1-4615-b2ed-829a435fa353 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:52.696952 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9c72ec3d-b4a1-4615-b2ed-829a435fa353 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:52.849574 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-9c72ec3d-b4a1-4615-b2ed-829a435fa353 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:52.860380 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-9c72ec3d-b4a1-4615-b2ed-829a435fa353 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1523 microversion: 2.1 time: 0.181352 Jun 30 10:01:52.861302 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 92/175] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:52 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:01:53.250875 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-fd990d39-e2ea-4596-add9-73d2f1e7e040 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:53.251459 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-fd990d39-e2ea-4596-add9-73d2f1e7e040 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] [instance: 824b275d-6e49-45e7-b792-ec245f21a2dd] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:53.260522 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fd990d39-e2ea-4596-add9-73d2f1e7e040 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:53.261203 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fd990d39-e2ea-4596-add9-73d2f1e7e040 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:53.262132 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fd990d39-e2ea-4596-add9-73d2f1e7e040 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:53.262767 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fd990d39-e2ea-4596-add9-73d2f1e7e040 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:53.371112 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-fd990d39-e2ea-4596-add9-73d2f1e7e040 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fe0b9043ad479284163d04a90b842f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae600a17f9437d9e62475696c106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:53.382969 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-fd990d39-e2ea-4596-add9-73d2f1e7e040 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] 10.222.0.16 "GET /compute/v2.1/servers/824b275d-6e49-45e7-b792-ec245f21a2dd" status: 200 len: 1273 microversion: 2.1 time: 0.135938 Jun 30 10:01:53.385924 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 84/176] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:53 2022] GET /compute/v2.1/servers/824b275d-6e49-45e7-b792-ec245f21a2dd => generated 1273 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:53.878017 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-2524c1dd-69fe-49e8-8eae-4b2534aec93b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:53.879299 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-2524c1dd-69fe-49e8-8eae-4b2534aec93b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:53.885913 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2524c1dd-69fe-49e8-8eae-4b2534aec93b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:53.886358 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2524c1dd-69fe-49e8-8eae-4b2534aec93b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:53.887119 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2524c1dd-69fe-49e8-8eae-4b2534aec93b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:53.887702 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2524c1dd-69fe-49e8-8eae-4b2534aec93b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:54.120795 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-2524c1dd-69fe-49e8-8eae-4b2534aec93b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:54.128731 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-2524c1dd-69fe-49e8-8eae-4b2534aec93b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1523 microversion: 2.1 time: 0.254713 Jun 30 10:01:54.129500 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 93/177] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:53 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1523 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:54.402125 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-1e6ad1ca-f5af-4863-a84c-72acf3003ce7 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:54.403378 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-1e6ad1ca-f5af-4863-a84c-72acf3003ce7 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] [instance: 824b275d-6e49-45e7-b792-ec245f21a2dd] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:54.412609 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1e6ad1ca-f5af-4863-a84c-72acf3003ce7 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:54.413288 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1e6ad1ca-f5af-4863-a84c-72acf3003ce7 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:54.414815 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1e6ad1ca-f5af-4863-a84c-72acf3003ce7 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:54.415326 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1e6ad1ca-f5af-4863-a84c-72acf3003ce7 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:54.637826 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-1e6ad1ca-f5af-4863-a84c-72acf3003ce7 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fe0b9043ad479284163d04a90b842f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae600a17f9437d9e62475696c106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:54.652685 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-1e6ad1ca-f5af-4863-a84c-72acf3003ce7 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] 10.222.0.16 "GET /compute/v2.1/servers/824b275d-6e49-45e7-b792-ec245f21a2dd" status: 200 len: 1313 microversion: 2.1 time: 0.255407 Jun 30 10:01:54.653898 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 85/178] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:54 2022] GET /compute/v2.1/servers/824b275d-6e49-45e7-b792-ec245f21a2dd => generated 1313 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:54.960855 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [req-9ba9f562-1ab4-458b-9d27-0dfa7d8fa4e4 req-70183b81-de65-4ef0-a381-2fc5fd79d1d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "824b275d-6e49-45e7-b792-ec245f21a2dd", "tag": "59269cd2-ae3a-4896-a931-6ec8593b48a6"}]} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:01:54.976268 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-9ba9f562-1ab4-458b-9d27-0dfa7d8fa4e4 req-70183b81-de65-4ef0-a381-2fc5fd79d1d8 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:54.976980 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-9ba9f562-1ab4-458b-9d27-0dfa7d8fa4e4 req-70183b81-de65-4ef0-a381-2fc5fd79d1d8 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:54.989015 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.compute.server_external_events [req-9ba9f562-1ab4-458b-9d27-0dfa7d8fa4e4 req-70183b81-de65-4ef0-a381-2fc5fd79d1d8 service nova] Creating event network-changed:59269cd2-ae3a-4896-a931-6ec8593b48a6 for instance 824b275d-6e49-45e7-b792-ec245f21a2dd on hv-cinder-84330 Jun 30 10:01:54.994022 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [req-9ba9f562-1ab4-458b-9d27-0dfa7d8fa4e4 req-70183b81-de65-4ef0-a381-2fc5fd79d1d8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043683 Jun 30 10:01:54.994622 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 94/179] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:01:55.147059 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f1dacb88-243e-4296-8e9a-32f564938dda tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:55.148372 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f1dacb88-243e-4296-8e9a-32f564938dda tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:55.155313 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f1dacb88-243e-4296-8e9a-32f564938dda tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:55.156054 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f1dacb88-243e-4296-8e9a-32f564938dda tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:55.156809 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f1dacb88-243e-4296-8e9a-32f564938dda tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:55.157233 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f1dacb88-243e-4296-8e9a-32f564938dda tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:55.423734 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f1dacb88-243e-4296-8e9a-32f564938dda tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:55.432779 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f1dacb88-243e-4296-8e9a-32f564938dda tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1523 microversion: 2.1 time: 0.290059 Jun 30 10:01:55.438083 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 86/180] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:55 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1523 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:55.676495 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-704feaab-4c54-4dd7-8c33-0f735c93236d tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:55.678139 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-704feaab-4c54-4dd7-8c33-0f735c93236d tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] [instance: 824b275d-6e49-45e7-b792-ec245f21a2dd] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:55.687916 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-704feaab-4c54-4dd7-8c33-0f735c93236d tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:55.688752 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-704feaab-4c54-4dd7-8c33-0f735c93236d tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:55.689669 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-704feaab-4c54-4dd7-8c33-0f735c93236d tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:55.690498 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-704feaab-4c54-4dd7-8c33-0f735c93236d tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:55.851370 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-704feaab-4c54-4dd7-8c33-0f735c93236d tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fe0b9043ad479284163d04a90b842f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae600a17f9437d9e62475696c106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:55.860092 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-704feaab-4c54-4dd7-8c33-0f735c93236d tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] 10.222.0.16 "GET /compute/v2.1/servers/824b275d-6e49-45e7-b792-ec245f21a2dd" status: 200 len: 1313 microversion: 2.1 time: 0.192112 Jun 30 10:01:55.860757 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 95/181] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:55 2022] GET /compute/v2.1/servers/824b275d-6e49-45e7-b792-ec245f21a2dd => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:56.454836 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-26884b3c-afad-49dc-b587-d28cdbb1e007 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:56.455630 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-26884b3c-afad-49dc-b587-d28cdbb1e007 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:56.462634 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-26884b3c-afad-49dc-b587-d28cdbb1e007 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:56.462955 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-26884b3c-afad-49dc-b587-d28cdbb1e007 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:56.463660 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-26884b3c-afad-49dc-b587-d28cdbb1e007 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:56.464241 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-26884b3c-afad-49dc-b587-d28cdbb1e007 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:56.603013 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-26884b3c-afad-49dc-b587-d28cdbb1e007 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:56.611371 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-26884b3c-afad-49dc-b587-d28cdbb1e007 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1523 microversion: 2.1 time: 0.160857 Jun 30 10:01:56.612233 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 87/182] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:56 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:56.882277 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-19427d9f-be24-4c5c-a956-bb00647258b7 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:56.882876 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-19427d9f-be24-4c5c-a956-bb00647258b7 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] [instance: 824b275d-6e49-45e7-b792-ec245f21a2dd] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:56.889144 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-19427d9f-be24-4c5c-a956-bb00647258b7 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:56.889584 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-19427d9f-be24-4c5c-a956-bb00647258b7 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:56.890343 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-19427d9f-be24-4c5c-a956-bb00647258b7 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:56.890775 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-19427d9f-be24-4c5c-a956-bb00647258b7 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:57.125490 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-19427d9f-be24-4c5c-a956-bb00647258b7 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fe0b9043ad479284163d04a90b842f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae600a17f9437d9e62475696c106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:57.147337 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-19427d9f-be24-4c5c-a956-bb00647258b7 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] 10.222.0.16 "GET /compute/v2.1/servers/824b275d-6e49-45e7-b792-ec245f21a2dd" status: 200 len: 1313 microversion: 2.1 time: 0.268565 Jun 30 10:01:57.148302 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 96/183] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:56 2022] GET /compute/v2.1/servers/824b275d-6e49-45e7-b792-ec245f21a2dd => generated 1313 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:57.629505 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-71142541-55ef-40e1-ab55-5bbb467d54ee tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:57.630852 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-71142541-55ef-40e1-ab55-5bbb467d54ee tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:57.637949 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-71142541-55ef-40e1-ab55-5bbb467d54ee tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:57.638790 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-71142541-55ef-40e1-ab55-5bbb467d54ee tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:57.640071 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-71142541-55ef-40e1-ab55-5bbb467d54ee tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:57.640318 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-71142541-55ef-40e1-ab55-5bbb467d54ee tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:57.894660 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-71142541-55ef-40e1-ab55-5bbb467d54ee tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:57.903446 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-71142541-55ef-40e1-ab55-5bbb467d54ee tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1523 microversion: 2.1 time: 0.278825 Jun 30 10:01:57.904042 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 88/184] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:57 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1523 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:58.164689 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-5f5185a3-7d22-4306-831f-2e3f368c4e59 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:58.165293 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-5f5185a3-7d22-4306-831f-2e3f368c4e59 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] [instance: 824b275d-6e49-45e7-b792-ec245f21a2dd] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:58.171340 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-5f5185a3-7d22-4306-831f-2e3f368c4e59 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:58.171782 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-5f5185a3-7d22-4306-831f-2e3f368c4e59 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:58.172578 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-5f5185a3-7d22-4306-831f-2e3f368c4e59 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:58.173003 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-5f5185a3-7d22-4306-831f-2e3f368c4e59 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:58.318946 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-5f5185a3-7d22-4306-831f-2e3f368c4e59 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fe0b9043ad479284163d04a90b842f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae600a17f9437d9e62475696c106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:58.327283 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-5f5185a3-7d22-4306-831f-2e3f368c4e59 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] 10.222.0.16 "GET /compute/v2.1/servers/824b275d-6e49-45e7-b792-ec245f21a2dd" status: 200 len: 1313 microversion: 2.1 time: 0.166714 Jun 30 10:01:58.327863 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 97/185] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:58 2022] GET /compute/v2.1/servers/824b275d-6e49-45e7-b792-ec245f21a2dd => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:01:58.920213 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-c75302a5-3067-44c4-bf82-1a718ff3cc90 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:58.920986 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-c75302a5-3067-44c4-bf82-1a718ff3cc90 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:58.961588 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c75302a5-3067-44c4-bf82-1a718ff3cc90 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:58.962568 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c75302a5-3067-44c4-bf82-1a718ff3cc90 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:58.964484 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c75302a5-3067-44c4-bf82-1a718ff3cc90 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:58.965157 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c75302a5-3067-44c4-bf82-1a718ff3cc90 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:59.122060 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-c75302a5-3067-44c4-bf82-1a718ff3cc90 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:59.134362 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-c75302a5-3067-44c4-bf82-1a718ff3cc90 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1523 microversion: 2.1 time: 0.218242 Jun 30 10:01:59.135203 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 89/186] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:58 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1523 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:01:59.344376 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-e07cd271-94fb-4846-8589-dbca3e795483 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:01:59.345129 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-e07cd271-94fb-4846-8589-dbca3e795483 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] [instance: 824b275d-6e49-45e7-b792-ec245f21a2dd] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:01:59.350279 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:01:59.353293 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e07cd271-94fb-4846-8589-dbca3e795483 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:59.353940 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e07cd271-94fb-4846-8589-dbca3e795483 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:59.354875 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e07cd271-94fb-4846-8589-dbca3e795483 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:01:59.355301 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e07cd271-94fb-4846-8589-dbca3e795483 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:01:59.500517 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-e07cd271-94fb-4846-8589-dbca3e795483 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fe0b9043ad479284163d04a90b842f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae600a17f9437d9e62475696c106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:01:59.510005 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-e07cd271-94fb-4846-8589-dbca3e795483 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] 10.222.0.16 "GET /compute/v2.1/servers/824b275d-6e49-45e7-b792-ec245f21a2dd" status: 200 len: 1313 microversion: 2.1 time: 0.169791 Jun 30 10:01:59.510583 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 98/187] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:01:59 2022] GET /compute/v2.1/servers/824b275d-6e49-45e7-b792-ec245f21a2dd => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:00.151862 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f548e07a-6ec0-42bd-9b0a-b07fec181dc6 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:00.153231 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f548e07a-6ec0-42bd-9b0a-b07fec181dc6 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:00.160123 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f548e07a-6ec0-42bd-9b0a-b07fec181dc6 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:00.160561 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f548e07a-6ec0-42bd-9b0a-b07fec181dc6 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:00.161316 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f548e07a-6ec0-42bd-9b0a-b07fec181dc6 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:00.161740 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f548e07a-6ec0-42bd-9b0a-b07fec181dc6 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:00.289082 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [req-3c284606-0af9-4861-89b5-cd02e898c0ec req-f8042eb5-b927-4b52-8a9d-76fb70a4c550 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "824b275d-6e49-45e7-b792-ec245f21a2dd", "name": "network-vif-plugged", "status": "completed", "tag": "59269cd2-ae3a-4896-a931-6ec8593b48a6"}]} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:02:00.305653 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-3c284606-0af9-4861-89b5-cd02e898c0ec req-f8042eb5-b927-4b52-8a9d-76fb70a4c550 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:00.306208 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-3c284606-0af9-4861-89b5-cd02e898c0ec req-f8042eb5-b927-4b52-8a9d-76fb70a4c550 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:00.337410 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.compute.server_external_events [req-3c284606-0af9-4861-89b5-cd02e898c0ec req-f8042eb5-b927-4b52-8a9d-76fb70a4c550 service nova] Creating event network-vif-plugged:59269cd2-ae3a-4896-a931-6ec8593b48a6 for instance 824b275d-6e49-45e7-b792-ec245f21a2dd on hv-cinder-84330 Jun 30 10:02:00.342917 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [req-3c284606-0af9-4861-89b5-cd02e898c0ec req-f8042eb5-b927-4b52-8a9d-76fb70a4c550 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058236 Jun 30 10:02:00.345504 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 99/188] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:02:00.351217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f548e07a-6ec0-42bd-9b0a-b07fec181dc6 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:00.360178 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f548e07a-6ec0-42bd-9b0a-b07fec181dc6 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1523 microversion: 2.1 time: 0.212625 Jun 30 10:02:00.360971 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 90/189] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:00 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1523 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:00.528048 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-4551ee5b-4ac7-4d0b-9ae6-ef480783a9a6 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:00.528780 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-4551ee5b-4ac7-4d0b-9ae6-ef480783a9a6 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] [instance: 824b275d-6e49-45e7-b792-ec245f21a2dd] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:00.535958 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4551ee5b-4ac7-4d0b-9ae6-ef480783a9a6 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:00.536403 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4551ee5b-4ac7-4d0b-9ae6-ef480783a9a6 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:00.537269 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4551ee5b-4ac7-4d0b-9ae6-ef480783a9a6 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:00.537881 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4551ee5b-4ac7-4d0b-9ae6-ef480783a9a6 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:00.671234 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-4551ee5b-4ac7-4d0b-9ae6-ef480783a9a6 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fe0b9043ad479284163d04a90b842f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae600a17f9437d9e62475696c106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:00.679022 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-4551ee5b-4ac7-4d0b-9ae6-ef480783a9a6 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] 10.222.0.16 "GET /compute/v2.1/servers/824b275d-6e49-45e7-b792-ec245f21a2dd" status: 200 len: 1313 microversion: 2.1 time: 0.155982 Jun 30 10:02:00.679571 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 100/190] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:00 2022] GET /compute/v2.1/servers/824b275d-6e49-45e7-b792-ec245f21a2dd => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:01.381513 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-9572fad3-7731-4102-b66d-ae768d3bc37f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:01.382529 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-9572fad3-7731-4102-b66d-ae768d3bc37f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:01.393388 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9572fad3-7731-4102-b66d-ae768d3bc37f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:01.394129 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9572fad3-7731-4102-b66d-ae768d3bc37f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:01.395367 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9572fad3-7731-4102-b66d-ae768d3bc37f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:01.396132 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9572fad3-7731-4102-b66d-ae768d3bc37f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:01.537069 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-9572fad3-7731-4102-b66d-ae768d3bc37f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:01.546013 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-9572fad3-7731-4102-b66d-ae768d3bc37f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1523 microversion: 2.1 time: 0.170952 Jun 30 10:02:01.546589 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 91/191] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:01 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:01.698200 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-abdf43ee-9662-4347-a54e-9887273c2c8a tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:01.698787 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-abdf43ee-9662-4347-a54e-9887273c2c8a tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] [instance: 824b275d-6e49-45e7-b792-ec245f21a2dd] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:01.705487 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-abdf43ee-9662-4347-a54e-9887273c2c8a tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:01.705935 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-abdf43ee-9662-4347-a54e-9887273c2c8a tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:01.706813 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-abdf43ee-9662-4347-a54e-9887273c2c8a tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:01.707124 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-abdf43ee-9662-4347-a54e-9887273c2c8a tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:01.849527 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-abdf43ee-9662-4347-a54e-9887273c2c8a tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fe0b9043ad479284163d04a90b842f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae600a17f9437d9e62475696c106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:01.858033 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-abdf43ee-9662-4347-a54e-9887273c2c8a tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] 10.222.0.16 "GET /compute/v2.1/servers/824b275d-6e49-45e7-b792-ec245f21a2dd" status: 200 len: 1313 microversion: 2.1 time: 0.165294 Jun 30 10:02:01.858590 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 101/192] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:01 2022] GET /compute/v2.1/servers/824b275d-6e49-45e7-b792-ec245f21a2dd => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:02.565578 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-2b761b94-4bfb-4d87-92ae-3a6df8cf8aa4 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:02.567079 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-2b761b94-4bfb-4d87-92ae-3a6df8cf8aa4 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:02.572507 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=2 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:02:02.580782 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2b761b94-4bfb-4d87-92ae-3a6df8cf8aa4 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:02.581497 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2b761b94-4bfb-4d87-92ae-3a6df8cf8aa4 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:02.582511 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2b761b94-4bfb-4d87-92ae-3a6df8cf8aa4 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:02.583151 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2b761b94-4bfb-4d87-92ae-3a6df8cf8aa4 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:02.818964 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-2b761b94-4bfb-4d87-92ae-3a6df8cf8aa4 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:02.828714 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-2b761b94-4bfb-4d87-92ae-3a6df8cf8aa4 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1523 microversion: 2.1 time: 0.269902 Jun 30 10:02:02.829389 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 92/193] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:02 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1523 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:02:02.878946 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-d7086ec7-addf-424e-ab06-6577d1426145 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:02.879556 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-d7086ec7-addf-424e-ab06-6577d1426145 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] [instance: 824b275d-6e49-45e7-b792-ec245f21a2dd] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:02.881633 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell0:SELECT=2 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:02:02.882482 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell0:SELECT=6 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:02:02.889061 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d7086ec7-addf-424e-ab06-6577d1426145 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:02.889851 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d7086ec7-addf-424e-ab06-6577d1426145 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:02.890497 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d7086ec7-addf-424e-ab06-6577d1426145 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:02.890929 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d7086ec7-addf-424e-ab06-6577d1426145 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:03.054329 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-d7086ec7-addf-424e-ab06-6577d1426145 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fe0b9043ad479284163d04a90b842f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae600a17f9437d9e62475696c106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:03.062303 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-d7086ec7-addf-424e-ab06-6577d1426145 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] 10.222.0.16 "GET /compute/v2.1/servers/824b275d-6e49-45e7-b792-ec245f21a2dd" status: 200 len: 1313 microversion: 2.1 time: 0.187842 Jun 30 10:02:03.063162 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 102/194] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:02 2022] GET /compute/v2.1/servers/824b275d-6e49-45e7-b792-ec245f21a2dd => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:03.850434 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-a733a21b-f2b3-47f6-8d31-58d760c96b27 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:03.851708 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-a733a21b-f2b3-47f6-8d31-58d760c96b27 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:03.860495 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a733a21b-f2b3-47f6-8d31-58d760c96b27 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:03.861004 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a733a21b-f2b3-47f6-8d31-58d760c96b27 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:03.862148 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a733a21b-f2b3-47f6-8d31-58d760c96b27 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:03.862661 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a733a21b-f2b3-47f6-8d31-58d760c96b27 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:04.004028 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-a733a21b-f2b3-47f6-8d31-58d760c96b27 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:04.013969 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-a733a21b-f2b3-47f6-8d31-58d760c96b27 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1523 microversion: 2.1 time: 0.170398 Jun 30 10:02:04.014562 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 93/195] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:03 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:04.084042 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-01ab4f99-c2b8-4c1f-9286-9d6b6beec93e tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:04.085608 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-01ab4f99-c2b8-4c1f-9286-9d6b6beec93e tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] [instance: 824b275d-6e49-45e7-b792-ec245f21a2dd] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:04.097024 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-01ab4f99-c2b8-4c1f-9286-9d6b6beec93e tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:04.097444 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-01ab4f99-c2b8-4c1f-9286-9d6b6beec93e tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:04.098223 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-01ab4f99-c2b8-4c1f-9286-9d6b6beec93e tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:04.098631 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-01ab4f99-c2b8-4c1f-9286-9d6b6beec93e tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:04.268100 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-01ab4f99-c2b8-4c1f-9286-9d6b6beec93e tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fe0b9043ad479284163d04a90b842f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae600a17f9437d9e62475696c106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:04.273885 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-01ab4f99-c2b8-4c1f-9286-9d6b6beec93e tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] 10.222.0.16 "GET /compute/v2.1/servers/824b275d-6e49-45e7-b792-ec245f21a2dd" status: 200 len: 1313 microversion: 2.1 time: 0.197155 Jun 30 10:02:04.274379 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 103/196] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:04 2022] GET /compute/v2.1/servers/824b275d-6e49-45e7-b792-ec245f21a2dd => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:05.031464 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-b3cbc43b-db60-4129-8615-d5658a5e10f7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:05.032201 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-b3cbc43b-db60-4129-8615-d5658a5e10f7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:05.042588 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b3cbc43b-db60-4129-8615-d5658a5e10f7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:05.043128 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b3cbc43b-db60-4129-8615-d5658a5e10f7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:05.044332 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b3cbc43b-db60-4129-8615-d5658a5e10f7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:05.044892 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b3cbc43b-db60-4129-8615-d5658a5e10f7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:05.189321 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-b3cbc43b-db60-4129-8615-d5658a5e10f7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:05.201244 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-b3cbc43b-db60-4129-8615-d5658a5e10f7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1503 microversion: 2.1 time: 0.173774 Jun 30 10:02:05.202126 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 94/197] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:05 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1503 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:05.222216 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-d63282ab-4c5f-4ffd-989c-37d03f127ba3 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:05.222822 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-d63282ab-4c5f-4ffd-989c-37d03f127ba3 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:05.229087 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d63282ab-4c5f-4ffd-989c-37d03f127ba3 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:05.229544 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d63282ab-4c5f-4ffd-989c-37d03f127ba3 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:05.230316 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d63282ab-4c5f-4ffd-989c-37d03f127ba3 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:05.230744 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d63282ab-4c5f-4ffd-989c-37d03f127ba3 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:05.300773 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-a877a26c-74cc-4eeb-bc8e-6b68c198ac1e tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:05.301601 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-a877a26c-74cc-4eeb-bc8e-6b68c198ac1e tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] [instance: 824b275d-6e49-45e7-b792-ec245f21a2dd] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:05.308187 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a877a26c-74cc-4eeb-bc8e-6b68c198ac1e tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:05.308633 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a877a26c-74cc-4eeb-bc8e-6b68c198ac1e tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:05.309390 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a877a26c-74cc-4eeb-bc8e-6b68c198ac1e tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:05.309821 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a877a26c-74cc-4eeb-bc8e-6b68c198ac1e tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:05.424749 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-d63282ab-4c5f-4ffd-989c-37d03f127ba3 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:05.434351 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-d63282ab-4c5f-4ffd-989c-37d03f127ba3 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 200 len: 1516 microversion: 2.1 time: 0.215752 Jun 30 10:02:05.435163 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 104/198] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:05 2022] GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 1516 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:05.484688 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-a877a26c-74cc-4eeb-bc8e-6b68c198ac1e tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fe0b9043ad479284163d04a90b842f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae600a17f9437d9e62475696c106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:05.493735 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-a877a26c-74cc-4eeb-bc8e-6b68c198ac1e tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] 10.222.0.16 "GET /compute/v2.1/servers/824b275d-6e49-45e7-b792-ec245f21a2dd" status: 200 len: 1497 microversion: 2.1 time: 0.206566 Jun 30 10:02:05.494777 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 95/199] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:05 2022] GET /compute/v2.1/servers/824b275d-6e49-45e7-b792-ec245f21a2dd => generated 1497 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:02:06.158044 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-8ce8437d-6b1d-407e-9dca-3c2e0f841fd8 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:06.158702 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-8ce8437d-6b1d-407e-9dca-3c2e0f841fd8 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] [instance: 824b275d-6e49-45e7-b792-ec245f21a2dd] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:06.165574 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8ce8437d-6b1d-407e-9dca-3c2e0f841fd8 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:06.166175 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8ce8437d-6b1d-407e-9dca-3c2e0f841fd8 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:06.167036 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8ce8437d-6b1d-407e-9dca-3c2e0f841fd8 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:06.167579 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8ce8437d-6b1d-407e-9dca-3c2e0f841fd8 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:06.173083 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell1:SELECT=100 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:02:06.193863 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-8ce8437d-6b1d-407e-9dca-3c2e0f841fd8 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] [instance: 824b275d-6e49-45e7-b792-ec245f21a2dd] Going to try to terminate instance {{(pid=117847) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 10:02:06.286136 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-8ce8437d-6b1d-407e-9dca-3c2e0f841fd8 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] 10.222.0.16 "DELETE /compute/v2.1/servers/824b275d-6e49-45e7-b792-ec245f21a2dd" status: 204 len: 0 microversion: 2.1 time: 0.131819 Jun 30 10:02:06.286970 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 105/200] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 10:02:06 2022] DELETE /compute/v2.1/servers/824b275d-6e49-45e7-b792-ec245f21a2dd => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 30 10:02:06.296640 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-6e5a5b6c-5820-4114-8572-490ab240c105 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:06.298269 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-6e5a5b6c-5820-4114-8572-490ab240c105 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] [instance: 824b275d-6e49-45e7-b792-ec245f21a2dd] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:06.301749 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=54 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:02:06.305983 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6e5a5b6c-5820-4114-8572-490ab240c105 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:06.306430 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6e5a5b6c-5820-4114-8572-490ab240c105 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:06.307193 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6e5a5b6c-5820-4114-8572-490ab240c105 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:06.307620 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6e5a5b6c-5820-4114-8572-490ab240c105 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:06.463106 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-6e5a5b6c-5820-4114-8572-490ab240c105 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fe0b9043ad479284163d04a90b842f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae600a17f9437d9e62475696c106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:06.467309 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=100 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:02:06.472237 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-6e5a5b6c-5820-4114-8572-490ab240c105 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] 10.222.0.16 "GET /compute/v2.1/servers/824b275d-6e49-45e7-b792-ec245f21a2dd" status: 200 len: 1503 microversion: 2.1 time: 0.180680 Jun 30 10:02:06.473240 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 96/201] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:06 2022] GET /compute/v2.1/servers/824b275d-6e49-45e7-b792-ec245f21a2dd => generated 1503 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:06.907303 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-3dfdb51c-9e5f-4fbb-a362-671090f4e33c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:02:06.908646 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-3dfdb51c-9e5f-4fbb-a362-671090f4e33c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:06.914868 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3dfdb51c-9e5f-4fbb-a362-671090f4e33c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:06.915315 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3dfdb51c-9e5f-4fbb-a362-671090f4e33c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:06.916135 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3dfdb51c-9e5f-4fbb-a362-671090f4e33c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:06.916565 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3dfdb51c-9e5f-4fbb-a362-671090f4e33c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:06.940267 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.objects.instance [None req-3dfdb51c-9e5f-4fbb-a362-671090f4e33c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lazy-loading 'flavor' on Instance uuid 3aa5453f-b4af-4817-a8d4-173f27d1cbd3 {{(pid=117847) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:02:07.058559 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-3dfdb51c-9e5f-4fbb-a362-671090f4e33c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "POST /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3/action" status: 200 len: 32 microversion: 2.1 time: 0.155401 Jun 30 10:02:07.063085 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 106/202] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Jun 30 10:02:06 2022] POST /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3/action => generated 32 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 10:02:07.068392 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-37f97bee-ae80-4bb2-ba90-565ebb14227d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:07.069550 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-37f97bee-ae80-4bb2-ba90-565ebb14227d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:07.077039 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-37f97bee-ae80-4bb2-ba90-565ebb14227d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:07.077712 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-37f97bee-ae80-4bb2-ba90-565ebb14227d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:07.078485 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-37f97bee-ae80-4bb2-ba90-565ebb14227d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:07.078910 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-37f97bee-ae80-4bb2-ba90-565ebb14227d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:07.267313 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-37f97bee-ae80-4bb2-ba90-565ebb14227d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:07.287358 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-37f97bee-ae80-4bb2-ba90-565ebb14227d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 200 len: 1522 microversion: 2.1 time: 0.222740 Jun 30 10:02:07.288236 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 97/203] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:07 2022] GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:07.490992 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-9d95d5a1-1d0d-4c74-954b-d57195c2a75f tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:07.491677 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-9d95d5a1-1d0d-4c74-954b-d57195c2a75f tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] [instance: 824b275d-6e49-45e7-b792-ec245f21a2dd] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:07.498867 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9d95d5a1-1d0d-4c74-954b-d57195c2a75f tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:07.499303 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9d95d5a1-1d0d-4c74-954b-d57195c2a75f tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:07.500179 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9d95d5a1-1d0d-4c74-954b-d57195c2a75f tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:07.500712 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9d95d5a1-1d0d-4c74-954b-d57195c2a75f tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:07.649001 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-9d95d5a1-1d0d-4c74-954b-d57195c2a75f tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fe0b9043ad479284163d04a90b842f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae600a17f9437d9e62475696c106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:07.659077 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-9d95d5a1-1d0d-4c74-954b-d57195c2a75f tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] 10.222.0.16 "GET /compute/v2.1/servers/824b275d-6e49-45e7-b792-ec245f21a2dd" status: 200 len: 1503 microversion: 2.1 time: 0.172148 Jun 30 10:02:07.659654 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 107/204] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:07 2022] GET /compute/v2.1/servers/824b275d-6e49-45e7-b792-ec245f21a2dd => generated 1503 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:08.305753 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-414890e5-7d5c-4eb4-9d34-9f16ce920318 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:08.306566 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-414890e5-7d5c-4eb4-9d34-9f16ce920318 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:08.314044 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-414890e5-7d5c-4eb4-9d34-9f16ce920318 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:08.314627 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-414890e5-7d5c-4eb4-9d34-9f16ce920318 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:08.315498 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-414890e5-7d5c-4eb4-9d34-9f16ce920318 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:08.316055 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-414890e5-7d5c-4eb4-9d34-9f16ce920318 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:08.670685 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-414890e5-7d5c-4eb4-9d34-9f16ce920318 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:08.681296 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-1c1715a5-73bf-4784-b4b4-241549cee8fe tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:08.682640 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-1c1715a5-73bf-4784-b4b4-241549cee8fe tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] [instance: 824b275d-6e49-45e7-b792-ec245f21a2dd] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:08.699397 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-414890e5-7d5c-4eb4-9d34-9f16ce920318 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 200 len: 1522 microversion: 2.1 time: 0.392337 Jun 30 10:02:08.711725 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1c1715a5-73bf-4784-b4b4-241549cee8fe tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:08.712334 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 98/205] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:08 2022] GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 1522 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:08.713497 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1c1715a5-73bf-4784-b4b4-241549cee8fe tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:08.714852 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1c1715a5-73bf-4784-b4b4-241549cee8fe tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:08.716075 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1c1715a5-73bf-4784-b4b4-241549cee8fe tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:08.899392 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-1c1715a5-73bf-4784-b4b4-241549cee8fe tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fe0b9043ad479284163d04a90b842f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae600a17f9437d9e62475696c106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:08.918164 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-1c1715a5-73bf-4784-b4b4-241549cee8fe tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] 10.222.0.16 "GET /compute/v2.1/servers/824b275d-6e49-45e7-b792-ec245f21a2dd" status: 200 len: 1461 microversion: 2.1 time: 0.244945 Jun 30 10:02:08.918834 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 108/206] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:08 2022] GET /compute/v2.1/servers/824b275d-6e49-45e7-b792-ec245f21a2dd => generated 1461 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:02:08.941273 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-9de8dd89-9b83-4b6e-9519-d8dc4b22f8ae req-5c1a03b5-4710-4be3-82a2-f997b304afc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "824b275d-6e49-45e7-b792-ec245f21a2dd", "name": "network-vif-deleted", "tag": "59269cd2-ae3a-4896-a931-6ec8593b48a6"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:02:08.967679 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-9de8dd89-9b83-4b6e-9519-d8dc4b22f8ae req-5c1a03b5-4710-4be3-82a2-f997b304afc1 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:08.968149 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-9de8dd89-9b83-4b6e-9519-d8dc4b22f8ae req-5c1a03b5-4710-4be3-82a2-f997b304afc1 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:08.988982 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-9de8dd89-9b83-4b6e-9519-d8dc4b22f8ae req-5c1a03b5-4710-4be3-82a2-f997b304afc1 service nova] Creating event network-vif-deleted:59269cd2-ae3a-4896-a931-6ec8593b48a6 for instance 824b275d-6e49-45e7-b792-ec245f21a2dd on hv-cinder-84330 Jun 30 10:02:08.996653 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-9de8dd89-9b83-4b6e-9519-d8dc4b22f8ae req-5c1a03b5-4710-4be3-82a2-f997b304afc1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062663 Jun 30 10:02:08.997482 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 99/207] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:02:09.717834 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-42e07975-133c-4064-ae68-7c31bd4b4bb9 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:09.718447 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-42e07975-133c-4064-ae68-7c31bd4b4bb9 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:09.724721 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-42e07975-133c-4064-ae68-7c31bd4b4bb9 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:09.725210 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-42e07975-133c-4064-ae68-7c31bd4b4bb9 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:09.726008 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-42e07975-133c-4064-ae68-7c31bd4b4bb9 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:09.726462 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-42e07975-133c-4064-ae68-7c31bd4b4bb9 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:09.936333 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-983cbd9c-df1e-4355-9b40-663d4c99a7cf tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:09.937289 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-983cbd9c-df1e-4355-9b40-663d4c99a7cf tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] [instance: 824b275d-6e49-45e7-b792-ec245f21a2dd] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:09.949199 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-983cbd9c-df1e-4355-9b40-663d4c99a7cf tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:09.950625 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-42e07975-133c-4064-ae68-7c31bd4b4bb9 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:09.951008 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-983cbd9c-df1e-4355-9b40-663d4c99a7cf tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:09.952226 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-983cbd9c-df1e-4355-9b40-663d4c99a7cf tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:09.952869 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-983cbd9c-df1e-4355-9b40-663d4c99a7cf tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:09.959355 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-42e07975-133c-4064-ae68-7c31bd4b4bb9 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 200 len: 1522 microversion: 2.1 time: 0.245393 Jun 30 10:02:09.960613 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 109/208] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:09 2022] GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:09.972529 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-983cbd9c-df1e-4355-9b40-663d4c99a7cf tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] HTTP exception thrown: Instance 824b275d-6e49-45e7-b792-ec245f21a2dd could not be found. Jun 30 10:02:09.974420 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-983cbd9c-df1e-4355-9b40-663d4c99a7cf tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Request method failure captured: Jun 30 10:02:09.974420 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: request: GET /compute/v2.1/servers/824b275d-6e49-45e7-b792-ec245f21a2dd HTTP/1.1 Jun 30 10:02:09.974420 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept: application/json Jun 30 10:02:09.974420 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jun 30 10:02:09.974420 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Connection: close Jun 30 10:02:09.974420 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jun 30 10:02:09.974420 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jun 30 10:02:09.974420 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Host: 10.222.0.16 Jun 30 10:02:09.974420 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jun 30 10:02:09.974420 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jun 30 10:02:09.974420 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABivXSNjruwTweZl_VDrVhhWjYNIjUe2UCmuLL1cd6RSw36AXtZU5mhJw0-QY0DP8uXo-8Udi57dgrX2UqweHv1jisOqkGjBDpN9ka3tEBnb2oOy2JqUj65eLRbfNczNrbg9-4dl2_37GAFPMBmVn362kPMqZg3GvYJIyYgLrfI2yfsVWA Jun 30 10:02:09.974420 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jun 30 10:02:09.974420 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jun 30 10:02:09.974420 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jun 30 10:02:09.974420 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jun 30 10:02:09.974420 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jun 30 10:02:09.974420 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jun 30 10:02:09.974420 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Id: 46ae600a17f9437d9e62475696c106ca Jun 30 10:02:09.974420 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-VolumesActionsTest-1121760829 Jun 30 10:02:09.974420 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Role: reader,member Jun 30 10:02:09.974420 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Roles: reader,member Jun 30 10:02:09.975927 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/46ae600a17f9437d9e62475696c106ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/46ae600a17f9437d9e62475696c106ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/46ae600a17f9437d9e62475696c106ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_46ae600a17f9437d9e62475696c106ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:02:09.975927 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-VolumesActionsTest-1121760829 Jun 30 10:02:09.975927 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 46ae600a17f9437d9e62475696c106ca Jun 30 10:02:09.975927 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-VolumesActionsTest-1121760829 Jun 30 10:02:09.975927 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User: tempest-VolumesActionsTest-1121760829-project Jun 30 10:02:09.975927 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jun 30 10:02:09.975927 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jun 30 10:02:09.975927 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Id: 64fe0b9043ad479284163d04a90b842f Jun 30 10:02:09.975927 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-VolumesActionsTest-1121760829-project Jun 30 10:02:09.975927 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: method: > Jun 30 10:02:09.975927 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: exception: Instance 824b275d-6e49-45e7-b792-ec245f21a2dd could not be found. Jun 30 10:02:09.975927 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: action_args: {'id': '824b275d-6e49-45e7-b792-ec245f21a2dd'} Jun 30 10:02:09.977117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:02:09.977117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:02:09.977117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:02:09.977117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:02:09.977117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:02:09.977117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:02:09.977117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:02:09.977117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:02:09.977117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:02:09.977117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:02:09.977117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 824b275d-6e49-45e7-b792-ec245f21a2dd could not be found. Jun 30 10:02:09.977117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:02:09.977117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:02:09.977117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:02:09.977117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:02:09.977117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:02:09.977117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:02:09.977117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:02:09.977117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:02:09.977117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:02:09.978445 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:02:09.978445 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:02:09.978445 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:02:09.978445 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:02:09.978445 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:02:09.978445 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:02:09.978445 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:02:09.978445 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 824b275d-6e49-45e7-b792-ec245f21a2dd could not be found. Jun 30 10:02:09.978445 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:02:09.978445 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:02:09.978445 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:02:09.978445 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:02:09.978445 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:02:09.978445 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:02:09.978445 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:02:09.978445 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:02:09.978445 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 824b275d-6e49-45e7-b792-ec245f21a2dd could not be found. Jun 30 10:02:09.978445 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:02:09.982441 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-983cbd9c-df1e-4355-9b40-663d4c99a7cf tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Returning 404 to user: Instance 824b275d-6e49-45e7-b792-ec245f21a2dd could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:02:09.983767 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-983cbd9c-df1e-4355-9b40-663d4c99a7cf tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] 10.222.0.16 "GET /compute/v2.1/servers/824b275d-6e49-45e7-b792-ec245f21a2dd" status: 404 len: 111 microversion: 2.1 time: 0.051913 Jun 30 10:02:09.984442 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 100/209] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:09 2022] GET /compute/v2.1/servers/824b275d-6e49-45e7-b792-ec245f21a2dd => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:02:10.123741 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-7f055c5e-e864-41fd-9d1c-be7b6c145671 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1844624783", "imageRef": "c9dccba6-70d7-4aa8-9b8f-9c88ef1af443", "flavorRef": "452", "networks": [{"uuid": "e1d0fb6e-ee6c-4ba0-b1f4-8ddcc62634ab"}]}} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:02:10.181178 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.network.neutron [None req-7f055c5e-e864-41fd-9d1c-be7b6c145671 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] validate_networks() for [('e1d0fb6e-ee6c-4ba0-b1f4-8ddcc62634ab', None, None, None, None, None)] {{(pid=117847) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 10:02:10.977779 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-94014469-d625-4581-9f7f-4841264d136a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:10.978409 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-94014469-d625-4581-9f7f-4841264d136a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:10.985533 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-94014469-d625-4581-9f7f-4841264d136a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:10.985979 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-94014469-d625-4581-9f7f-4841264d136a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:10.986903 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-94014469-d625-4581-9f7f-4841264d136a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:10.987340 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-94014469-d625-4581-9f7f-4841264d136a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:11.120522 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-7f055c5e-e864-41fd-9d1c-be7b6c145671 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Flavor limits 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 10:02:11.121834 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-7f055c5e-e864-41fd-9d1c-be7b6c145671 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Image limits 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 10:02:11.122786 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-7f055c5e-e864-41fd-9d1c-be7b6c145671 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Flavor pref 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 10:02:11.123426 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-7f055c5e-e864-41fd-9d1c-be7b6c145671 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Image pref 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 10:02:11.123892 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-7f055c5e-e864-41fd-9d1c-be7b6c145671 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 10:02:11.143722 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7f055c5e-e864-41fd-9d1c-be7b6c145671 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:11.144749 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7f055c5e-e864-41fd-9d1c-be7b6c145671 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:11.146356 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7f055c5e-e864-41fd-9d1c-be7b6c145671 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:11.147611 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7f055c5e-e864-41fd-9d1c-be7b6c145671 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:11.169205 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.quota [None req-7f055c5e-e864-41fd-9d1c-be7b6c145671 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Getting quotas for project 46ae600a17f9437d9e62475696c106ca. Resources: {'ram', 'instances', 'cores'} {{(pid=117847) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:02:11.173197 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.quota [None req-7f055c5e-e864-41fd-9d1c-be7b6c145671 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Getting quotas for user 64fe0b9043ad479284163d04a90b842f and project 46ae600a17f9437d9e62475696c106ca. Resources: {'ram', 'instances', 'cores'} {{(pid=117847) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:02:11.186878 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-7f055c5e-e864-41fd-9d1c-be7b6c145671 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Going to run 1 instances... {{(pid=117847) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 10:02:11.189264 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-7f055c5e-e864-41fd-9d1c-be7b6c145671 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] [instance: 15d991f3-3759-4c65-87b1-0cdb8ed5fcd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9dccba6-70d7-4aa8-9b8f-9c88ef1af443',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117847) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 10:02:11.263913 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-94014469-d625-4581-9f7f-4841264d136a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:11.272393 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-7f055c5e-e864-41fd-9d1c-be7b6c145671 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.152875 Jun 30 10:02:11.273715 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 110/210] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jun 30 10:02:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1155 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 30 10:02:11.288241 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-94014469-d625-4581-9f7f-4841264d136a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 200 len: 1522 microversion: 2.1 time: 0.315045 Jun 30 10:02:11.289549 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 101/211] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:10 2022] GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:11.300773 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-4665bec4-cfd1-4d81-b972-80de6052bc19 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:11.301628 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-4665bec4-cfd1-4d81-b972-80de6052bc19 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] [instance: 15d991f3-3759-4c65-87b1-0cdb8ed5fcd1] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:11.390248 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-4665bec4-cfd1-4d81-b972-80de6052bc19 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fe0b9043ad479284163d04a90b842f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae600a17f9437d9e62475696c106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:11.402059 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-4665bec4-cfd1-4d81-b972-80de6052bc19 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] 10.222.0.16 "GET /compute/v2.1/servers/15d991f3-3759-4c65-87b1-0cdb8ed5fcd1" status: 200 len: 1214 microversion: 2.1 time: 0.120641 Jun 30 10:02:11.402781 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 111/212] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:11 2022] GET /compute/v2.1/servers/15d991f3-3759-4c65-87b1-0cdb8ed5fcd1 => generated 1214 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:12.307139 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-2618268b-e39e-46ab-94d8-657c231c7721 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:12.308547 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-2618268b-e39e-46ab-94d8-657c231c7721 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:12.319642 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2618268b-e39e-46ab-94d8-657c231c7721 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:12.320139 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2618268b-e39e-46ab-94d8-657c231c7721 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:12.321651 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2618268b-e39e-46ab-94d8-657c231c7721 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:12.322087 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2618268b-e39e-46ab-94d8-657c231c7721 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:12.421705 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-d5639f77-a55d-4978-90f3-a2a8ed16f90f tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:12.422302 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-d5639f77-a55d-4978-90f3-a2a8ed16f90f tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] [instance: 15d991f3-3759-4c65-87b1-0cdb8ed5fcd1] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:12.448350 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d5639f77-a55d-4978-90f3-a2a8ed16f90f tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:12.450809 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d5639f77-a55d-4978-90f3-a2a8ed16f90f tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:12.451723 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d5639f77-a55d-4978-90f3-a2a8ed16f90f tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:12.452268 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d5639f77-a55d-4978-90f3-a2a8ed16f90f tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:12.473728 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-2618268b-e39e-46ab-94d8-657c231c7721 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:12.487464 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-2618268b-e39e-46ab-94d8-657c231c7721 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 200 len: 1522 microversion: 2.1 time: 0.185275 Jun 30 10:02:12.488158 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 102/213] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:12 2022] GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:12.544421 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-d5639f77-a55d-4978-90f3-a2a8ed16f90f tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fe0b9043ad479284163d04a90b842f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae600a17f9437d9e62475696c106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:12.554708 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-d5639f77-a55d-4978-90f3-a2a8ed16f90f tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] 10.222.0.16 "GET /compute/v2.1/servers/15d991f3-3759-4c65-87b1-0cdb8ed5fcd1" status: 200 len: 1266 microversion: 2.1 time: 0.136353 Jun 30 10:02:12.556064 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 112/214] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:12 2022] GET /compute/v2.1/servers/15d991f3-3759-4c65-87b1-0cdb8ed5fcd1 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:02:13.505231 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-56f54f03-bca5-42b2-9658-80e2d2e15c71 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:13.508258 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-56f54f03-bca5-42b2-9658-80e2d2e15c71 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:13.523364 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-56f54f03-bca5-42b2-9658-80e2d2e15c71 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:13.523844 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-56f54f03-bca5-42b2-9658-80e2d2e15c71 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:13.524630 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-56f54f03-bca5-42b2-9658-80e2d2e15c71 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:13.525064 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-56f54f03-bca5-42b2-9658-80e2d2e15c71 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:13.574913 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-cc7b3315-c2b0-4f39-a824-f6cd624e912e tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:13.576368 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-cc7b3315-c2b0-4f39-a824-f6cd624e912e tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] [instance: 15d991f3-3759-4c65-87b1-0cdb8ed5fcd1] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:13.589526 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-cc7b3315-c2b0-4f39-a824-f6cd624e912e tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:13.590283 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-cc7b3315-c2b0-4f39-a824-f6cd624e912e tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:13.591552 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-cc7b3315-c2b0-4f39-a824-f6cd624e912e tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:13.592302 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-cc7b3315-c2b0-4f39-a824-f6cd624e912e tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:13.859690 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-56f54f03-bca5-42b2-9658-80e2d2e15c71 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:13.870830 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-56f54f03-bca5-42b2-9658-80e2d2e15c71 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 200 len: 1522 microversion: 2.1 time: 0.369755 Jun 30 10:02:13.872656 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 103/215] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:13 2022] GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 1522 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:13.937342 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-cc7b3315-c2b0-4f39-a824-f6cd624e912e tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fe0b9043ad479284163d04a90b842f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae600a17f9437d9e62475696c106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:13.945568 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-cc7b3315-c2b0-4f39-a824-f6cd624e912e tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] 10.222.0.16 "GET /compute/v2.1/servers/15d991f3-3759-4c65-87b1-0cdb8ed5fcd1" status: 200 len: 1314 microversion: 2.1 time: 0.376287 Jun 30 10:02:13.946664 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 113/216] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:13 2022] GET /compute/v2.1/servers/15d991f3-3759-4c65-87b1-0cdb8ed5fcd1 => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:14.624267 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-4419ac66-63aa-4c1b-96f9-2cfcf35fdc72 req-e1ba0984-8c1e-4c6e-bf8d-5f8f67002017 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15d991f3-3759-4c65-87b1-0cdb8ed5fcd1", "tag": "3ce65f37-4f96-48ff-bd11-9a8f93b338d9"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:02:14.638140 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-4419ac66-63aa-4c1b-96f9-2cfcf35fdc72 req-e1ba0984-8c1e-4c6e-bf8d-5f8f67002017 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:14.638695 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-4419ac66-63aa-4c1b-96f9-2cfcf35fdc72 req-e1ba0984-8c1e-4c6e-bf8d-5f8f67002017 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:14.658849 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-4419ac66-63aa-4c1b-96f9-2cfcf35fdc72 req-e1ba0984-8c1e-4c6e-bf8d-5f8f67002017 service nova] Creating event network-changed:3ce65f37-4f96-48ff-bd11-9a8f93b338d9 for instance 15d991f3-3759-4c65-87b1-0cdb8ed5fcd1 on hv-cinder-84330 Jun 30 10:02:14.680741 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-4419ac66-63aa-4c1b-96f9-2cfcf35fdc72 req-e1ba0984-8c1e-4c6e-bf8d-5f8f67002017 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059821 Jun 30 10:02:14.682948 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 104/217] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:02:14.891440 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-c6b4ba84-68fa-4d0f-8ffb-29e526ecf2e4 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:14.892663 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-c6b4ba84-68fa-4d0f-8ffb-29e526ecf2e4 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:14.903800 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c6b4ba84-68fa-4d0f-8ffb-29e526ecf2e4 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:14.904762 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c6b4ba84-68fa-4d0f-8ffb-29e526ecf2e4 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:14.906012 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c6b4ba84-68fa-4d0f-8ffb-29e526ecf2e4 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:14.906718 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c6b4ba84-68fa-4d0f-8ffb-29e526ecf2e4 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:14.963781 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-07263e00-3dcb-44ef-9ee0-8b120e261f6e tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:14.965456 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-07263e00-3dcb-44ef-9ee0-8b120e261f6e tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] [instance: 15d991f3-3759-4c65-87b1-0cdb8ed5fcd1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:14.972407 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-07263e00-3dcb-44ef-9ee0-8b120e261f6e tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:14.975910 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-07263e00-3dcb-44ef-9ee0-8b120e261f6e tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:14.977307 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-07263e00-3dcb-44ef-9ee0-8b120e261f6e tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:14.977632 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-07263e00-3dcb-44ef-9ee0-8b120e261f6e tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:15.214988 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-c6b4ba84-68fa-4d0f-8ffb-29e526ecf2e4 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:15.224385 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-c6b4ba84-68fa-4d0f-8ffb-29e526ecf2e4 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 200 len: 1522 microversion: 2.1 time: 0.339273 Jun 30 10:02:15.224965 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 114/218] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:14 2022] GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 1522 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:15.302783 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-07263e00-3dcb-44ef-9ee0-8b120e261f6e tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fe0b9043ad479284163d04a90b842f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae600a17f9437d9e62475696c106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:15.313596 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-07263e00-3dcb-44ef-9ee0-8b120e261f6e tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] 10.222.0.16 "GET /compute/v2.1/servers/15d991f3-3759-4c65-87b1-0cdb8ed5fcd1" status: 200 len: 1314 microversion: 2.1 time: 0.353002 Jun 30 10:02:15.314783 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 105/219] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:14 2022] GET /compute/v2.1/servers/15d991f3-3759-4c65-87b1-0cdb8ed5fcd1 => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:02:16.246372 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-854b7c92-edc2-4e98-9acf-d46b6b9bd095 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:16.246991 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-854b7c92-edc2-4e98-9acf-d46b6b9bd095 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:16.266473 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-854b7c92-edc2-4e98-9acf-d46b6b9bd095 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:16.267137 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-854b7c92-edc2-4e98-9acf-d46b6b9bd095 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:16.268515 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-854b7c92-edc2-4e98-9acf-d46b6b9bd095 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:16.269519 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-854b7c92-edc2-4e98-9acf-d46b6b9bd095 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:16.332786 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e189f618-baeb-4f35-8a81-bcf1e1ab382d tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:16.333518 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-e189f618-baeb-4f35-8a81-bcf1e1ab382d tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] [instance: 15d991f3-3759-4c65-87b1-0cdb8ed5fcd1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:16.349677 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e189f618-baeb-4f35-8a81-bcf1e1ab382d tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:16.350872 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e189f618-baeb-4f35-8a81-bcf1e1ab382d tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:16.352016 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e189f618-baeb-4f35-8a81-bcf1e1ab382d tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:16.352652 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e189f618-baeb-4f35-8a81-bcf1e1ab382d tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:17.115597 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-854b7c92-edc2-4e98-9acf-d46b6b9bd095 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:17.135490 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-854b7c92-edc2-4e98-9acf-d46b6b9bd095 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 200 len: 1522 microversion: 2.1 time: 0.894461 Jun 30 10:02:17.147521 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 115/220] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:16 2022] GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 1522 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:17.168113 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e189f618-baeb-4f35-8a81-bcf1e1ab382d tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fe0b9043ad479284163d04a90b842f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae600a17f9437d9e62475696c106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:17.176106 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-e189f618-baeb-4f35-8a81-bcf1e1ab382d tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] 10.222.0.16 "GET /compute/v2.1/servers/15d991f3-3759-4c65-87b1-0cdb8ed5fcd1" status: 200 len: 1314 microversion: 2.1 time: 0.849076 Jun 30 10:02:17.180276 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 106/221] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:16 2022] GET /compute/v2.1/servers/15d991f3-3759-4c65-87b1-0cdb8ed5fcd1 => generated 1314 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:02:18.153582 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-4e808733-76d5-4a9d-a52a-5ef153220621 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:18.154286 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-4e808733-76d5-4a9d-a52a-5ef153220621 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:18.170021 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4e808733-76d5-4a9d-a52a-5ef153220621 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:18.170461 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4e808733-76d5-4a9d-a52a-5ef153220621 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:18.171243 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4e808733-76d5-4a9d-a52a-5ef153220621 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:18.171671 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4e808733-76d5-4a9d-a52a-5ef153220621 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:18.193037 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-3084a89a-ee90-4d6a-a4cf-c5720b183ecd tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:18.194962 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-3084a89a-ee90-4d6a-a4cf-c5720b183ecd tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] [instance: 15d991f3-3759-4c65-87b1-0cdb8ed5fcd1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:18.214520 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3084a89a-ee90-4d6a-a4cf-c5720b183ecd tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:18.215303 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3084a89a-ee90-4d6a-a4cf-c5720b183ecd tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:18.216147 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3084a89a-ee90-4d6a-a4cf-c5720b183ecd tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:18.216733 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3084a89a-ee90-4d6a-a4cf-c5720b183ecd tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:18.725801 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-3084a89a-ee90-4d6a-a4cf-c5720b183ecd tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fe0b9043ad479284163d04a90b842f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae600a17f9437d9e62475696c106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:18.735202 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-3084a89a-ee90-4d6a-a4cf-c5720b183ecd tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] 10.222.0.16 "GET /compute/v2.1/servers/15d991f3-3759-4c65-87b1-0cdb8ed5fcd1" status: 200 len: 1314 microversion: 2.1 time: 0.545931 Jun 30 10:02:18.736748 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 107/222] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:18 2022] GET /compute/v2.1/servers/15d991f3-3759-4c65-87b1-0cdb8ed5fcd1 => generated 1314 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:02:18.740934 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-4e808733-76d5-4a9d-a52a-5ef153220621 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:18.756460 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-4e808733-76d5-4a9d-a52a-5ef153220621 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 200 len: 1522 microversion: 2.1 time: 0.606790 Jun 30 10:02:18.758170 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 116/223] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:18 2022] GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 1522 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:02:19.754725 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e430b2bf-dff8-451f-ad64-f000cd7a2b0d tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:19.756081 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-e430b2bf-dff8-451f-ad64-f000cd7a2b0d tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] [instance: 15d991f3-3759-4c65-87b1-0cdb8ed5fcd1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:19.763589 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e430b2bf-dff8-451f-ad64-f000cd7a2b0d tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:19.764363 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e430b2bf-dff8-451f-ad64-f000cd7a2b0d tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:19.765337 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e430b2bf-dff8-451f-ad64-f000cd7a2b0d tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:19.765924 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e430b2bf-dff8-451f-ad64-f000cd7a2b0d tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:19.778104 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-0c86be39-f3e1-4471-a119-6bd7f17b483c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:19.783646 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-0c86be39-f3e1-4471-a119-6bd7f17b483c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:19.793901 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-0c86be39-f3e1-4471-a119-6bd7f17b483c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:19.795425 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-0c86be39-f3e1-4471-a119-6bd7f17b483c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:19.796467 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-0c86be39-f3e1-4471-a119-6bd7f17b483c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:19.797195 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-0c86be39-f3e1-4471-a119-6bd7f17b483c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:20.041508 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e430b2bf-dff8-451f-ad64-f000cd7a2b0d tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fe0b9043ad479284163d04a90b842f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae600a17f9437d9e62475696c106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:20.056915 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-e430b2bf-dff8-451f-ad64-f000cd7a2b0d tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] 10.222.0.16 "GET /compute/v2.1/servers/15d991f3-3759-4c65-87b1-0cdb8ed5fcd1" status: 200 len: 1314 microversion: 2.1 time: 0.305940 Jun 30 10:02:20.061998 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 108/224] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:19 2022] GET /compute/v2.1/servers/15d991f3-3759-4c65-87b1-0cdb8ed5fcd1 => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:20.083165 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-0c86be39-f3e1-4471-a119-6bd7f17b483c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:20.094870 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-0c86be39-f3e1-4471-a119-6bd7f17b483c tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 200 len: 1522 microversion: 2.1 time: 0.322009 Jun 30 10:02:20.104816 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 117/225] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:19 2022] GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:21.080807 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-56f126e0-f586-4327-a924-7b3a48481196 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:21.084634 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-56f126e0-f586-4327-a924-7b3a48481196 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] [instance: 15d991f3-3759-4c65-87b1-0cdb8ed5fcd1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:21.092347 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-56f126e0-f586-4327-a924-7b3a48481196 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:21.093548 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-56f126e0-f586-4327-a924-7b3a48481196 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:21.095237 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-56f126e0-f586-4327-a924-7b3a48481196 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:21.096165 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-56f126e0-f586-4327-a924-7b3a48481196 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:21.118496 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-5f5a56fa-d9a8-4206-b46d-0951c85ea396 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:21.119094 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-5f5a56fa-d9a8-4206-b46d-0951c85ea396 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:21.127533 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-5f5a56fa-d9a8-4206-b46d-0951c85ea396 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:21.128397 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-5f5a56fa-d9a8-4206-b46d-0951c85ea396 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:21.129507 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-5f5a56fa-d9a8-4206-b46d-0951c85ea396 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:21.130205 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-5f5a56fa-d9a8-4206-b46d-0951c85ea396 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:21.171414 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell0:SELECT=2 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:02:21.399648 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell0:SELECT=8 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:02:21.427618 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-5f5a56fa-d9a8-4206-b46d-0951c85ea396 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:21.436580 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-5f5a56fa-d9a8-4206-b46d-0951c85ea396 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 200 len: 1522 microversion: 2.1 time: 0.327714 Jun 30 10:02:21.438531 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-56f126e0-f586-4327-a924-7b3a48481196 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fe0b9043ad479284163d04a90b842f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae600a17f9437d9e62475696c106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:21.448846 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 118/226] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:21 2022] GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 1522 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:21.450092 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-56f126e0-f586-4327-a924-7b3a48481196 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] 10.222.0.16 "GET /compute/v2.1/servers/15d991f3-3759-4c65-87b1-0cdb8ed5fcd1" status: 200 len: 1314 microversion: 2.1 time: 0.373781 Jun 30 10:02:21.450731 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 109/227] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:21 2022] GET /compute/v2.1/servers/15d991f3-3759-4c65-87b1-0cdb8ed5fcd1 => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:22.139916 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [req-930d9579-a094-48d2-a43a-56a826a7a666 req-794c10b1-d677-4879-8116-52418c28c134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15d991f3-3759-4c65-87b1-0cdb8ed5fcd1", "name": "network-vif-plugged", "status": "completed", "tag": "3ce65f37-4f96-48ff-bd11-9a8f93b338d9"}]} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:02:22.152789 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-930d9579-a094-48d2-a43a-56a826a7a666 req-794c10b1-d677-4879-8116-52418c28c134 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:22.154540 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-930d9579-a094-48d2-a43a-56a826a7a666 req-794c10b1-d677-4879-8116-52418c28c134 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:22.172944 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.compute.server_external_events [req-930d9579-a094-48d2-a43a-56a826a7a666 req-794c10b1-d677-4879-8116-52418c28c134 service nova] Creating event network-vif-plugged:3ce65f37-4f96-48ff-bd11-9a8f93b338d9 for instance 15d991f3-3759-4c65-87b1-0cdb8ed5fcd1 on hv-cinder-84330 Jun 30 10:02:22.179007 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [req-930d9579-a094-48d2-a43a-56a826a7a666 req-794c10b1-d677-4879-8116-52418c28c134 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043552 Jun 30 10:02:22.180570 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 119/228] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:02:22.454615 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-63317759-3d89-4b96-af5a-76f9aac24871 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:22.459182 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-63317759-3d89-4b96-af5a-76f9aac24871 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:22.468530 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-480ae3d7-73c4-45d4-bc46-17e45f40b845 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:22.469598 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-480ae3d7-73c4-45d4-bc46-17e45f40b845 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] [instance: 15d991f3-3759-4c65-87b1-0cdb8ed5fcd1] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:22.482631 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-480ae3d7-73c4-45d4-bc46-17e45f40b845 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:22.483309 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-63317759-3d89-4b96-af5a-76f9aac24871 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:22.484052 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-480ae3d7-73c4-45d4-bc46-17e45f40b845 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:22.484714 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-63317759-3d89-4b96-af5a-76f9aac24871 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:22.485746 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-480ae3d7-73c4-45d4-bc46-17e45f40b845 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:22.486757 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-63317759-3d89-4b96-af5a-76f9aac24871 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:22.488468 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-480ae3d7-73c4-45d4-bc46-17e45f40b845 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:22.489109 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-63317759-3d89-4b96-af5a-76f9aac24871 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:22.523430 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:02:22.738548 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-63317759-3d89-4b96-af5a-76f9aac24871 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:22.749384 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-63317759-3d89-4b96-af5a-76f9aac24871 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 200 len: 1522 microversion: 2.1 time: 0.298762 Jun 30 10:02:22.749967 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 110/229] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:22 2022] GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:22.751773 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-480ae3d7-73c4-45d4-bc46-17e45f40b845 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fe0b9043ad479284163d04a90b842f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae600a17f9437d9e62475696c106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:22.758430 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-7c0f34b8-6116-41cc-869c-2f70cec84436 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:22.759050 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-7c0f34b8-6116-41cc-869c-2f70cec84436 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:22.759669 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-480ae3d7-73c4-45d4-bc46-17e45f40b845 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] 10.222.0.16 "GET /compute/v2.1/servers/15d991f3-3759-4c65-87b1-0cdb8ed5fcd1" status: 200 len: 1314 microversion: 2.1 time: 0.295850 Jun 30 10:02:22.760836 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 120/230] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:22 2022] GET /compute/v2.1/servers/15d991f3-3759-4c65-87b1-0cdb8ed5fcd1 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:02:22.765719 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7c0f34b8-6116-41cc-869c-2f70cec84436 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:22.766259 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7c0f34b8-6116-41cc-869c-2f70cec84436 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:22.767355 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7c0f34b8-6116-41cc-869c-2f70cec84436 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:22.767899 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7c0f34b8-6116-41cc-869c-2f70cec84436 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:22.803915 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-7c0f34b8-6116-41cc-869c-2f70cec84436 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d/ips" status: 200 len: 151 microversion: 2.20 time: 0.052772 Jun 30 10:02:22.804477 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 111/231] 10.222.0.16 () {60 vars in 1288 bytes} [Thu Jun 30 10:02:22 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d/ips => generated 151 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 10:02:23.486697 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-acc919fd-4477-41d3-8abe-815e64302dbf tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:23.487931 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-acc919fd-4477-41d3-8abe-815e64302dbf tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 18a19a8d-e121-4f9d-8906-574d6ecce160] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:23.500773 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-acc919fd-4477-41d3-8abe-815e64302dbf tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:23.501515 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-acc919fd-4477-41d3-8abe-815e64302dbf tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:23.507062 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-acc919fd-4477-41d3-8abe-815e64302dbf tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:23.508974 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-acc919fd-4477-41d3-8abe-815e64302dbf tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:23.589930 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-acc919fd-4477-41d3-8abe-815e64302dbf tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160/ips" status: 200 len: 150 microversion: 2.1 time: 0.109448 Jun 30 10:02:23.596336 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 121/232] 10.222.0.16 () {58 vars in 1247 bytes} [Thu Jun 30 10:02:23 2022] GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160/ips => generated 150 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:02:23.776573 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-99861a08-9c6f-49c8-bde3-3550c4071a2e tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:23.777182 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-99861a08-9c6f-49c8-bde3-3550c4071a2e tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] [instance: 15d991f3-3759-4c65-87b1-0cdb8ed5fcd1] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:23.780696 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-34b37b81-22bd-46cc-8f10-c23371c8ad0f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:23.781344 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-34b37b81-22bd-46cc-8f10-c23371c8ad0f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:23.807931 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-34b37b81-22bd-46cc-8f10-c23371c8ad0f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:23.808391 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-34b37b81-22bd-46cc-8f10-c23371c8ad0f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:23.809218 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-34b37b81-22bd-46cc-8f10-c23371c8ad0f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:23.809624 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-34b37b81-22bd-46cc-8f10-c23371c8ad0f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:23.812188 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-99861a08-9c6f-49c8-bde3-3550c4071a2e tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:23.812677 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-99861a08-9c6f-49c8-bde3-3550c4071a2e tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:23.817711 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-99861a08-9c6f-49c8-bde3-3550c4071a2e tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:23.818183 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-99861a08-9c6f-49c8-bde3-3550c4071a2e tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:24.179291 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-99861a08-9c6f-49c8-bde3-3550c4071a2e tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fe0b9043ad479284163d04a90b842f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae600a17f9437d9e62475696c106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:24.209796 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-99861a08-9c6f-49c8-bde3-3550c4071a2e tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] 10.222.0.16 "GET /compute/v2.1/servers/15d991f3-3759-4c65-87b1-0cdb8ed5fcd1" status: 200 len: 1314 microversion: 2.1 time: 0.436971 Jun 30 10:02:24.229553 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 122/233] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:23 2022] GET /compute/v2.1/servers/15d991f3-3759-4c65-87b1-0cdb8ed5fcd1 => generated 1314 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:02:24.254326 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-34b37b81-22bd-46cc-8f10-c23371c8ad0f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:24.268478 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-34b37b81-22bd-46cc-8f10-c23371c8ad0f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 200 len: 1522 microversion: 2.1 time: 0.505592 Jun 30 10:02:24.286698 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 112/234] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:23 2022] GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 1522 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:25.226724 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-4ff2e3b2-0cea-4bee-91ba-bc4b51f40843 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:25.227407 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-4ff2e3b2-0cea-4bee-91ba-bc4b51f40843 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] [instance: 15d991f3-3759-4c65-87b1-0cdb8ed5fcd1] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:25.234032 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4ff2e3b2-0cea-4bee-91ba-bc4b51f40843 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:25.234690 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4ff2e3b2-0cea-4bee-91ba-bc4b51f40843 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:25.235609 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4ff2e3b2-0cea-4bee-91ba-bc4b51f40843 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:25.236212 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4ff2e3b2-0cea-4bee-91ba-bc4b51f40843 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:25.305857 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-9dcec964-7752-4eb0-8b72-c42923e12738 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:25.309052 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-9dcec964-7752-4eb0-8b72-c42923e12738 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:25.328391 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9dcec964-7752-4eb0-8b72-c42923e12738 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:25.329032 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9dcec964-7752-4eb0-8b72-c42923e12738 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:25.329969 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9dcec964-7752-4eb0-8b72-c42923e12738 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:25.332169 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9dcec964-7752-4eb0-8b72-c42923e12738 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:25.493409 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-4ff2e3b2-0cea-4bee-91ba-bc4b51f40843 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fe0b9043ad479284163d04a90b842f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae600a17f9437d9e62475696c106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:25.508220 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-4ff2e3b2-0cea-4bee-91ba-bc4b51f40843 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] 10.222.0.16 "GET /compute/v2.1/servers/15d991f3-3759-4c65-87b1-0cdb8ed5fcd1" status: 200 len: 1498 microversion: 2.1 time: 0.279094 Jun 30 10:02:25.508902 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 123/235] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:25 2022] GET /compute/v2.1/servers/15d991f3-3759-4c65-87b1-0cdb8ed5fcd1 => generated 1498 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:25.515155 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-194c9c9e-16ea-4daa-94db-b610da57e6c0 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a44a4a04-03d7-46ca-a520-0273af8373d4"}} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:02:25.523043 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-194c9c9e-16ea-4daa-94db-b610da57e6c0 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 18a19a8d-e121-4f9d-8906-574d6ecce160] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:25.536409 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-194c9c9e-16ea-4daa-94db-b610da57e6c0 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:25.536871 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-194c9c9e-16ea-4daa-94db-b610da57e6c0 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:25.539326 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-194c9c9e-16ea-4daa-94db-b610da57e6c0 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:25.539326 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-194c9c9e-16ea-4daa-94db-b610da57e6c0 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:25.869155 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-9dcec964-7752-4eb0-8b72-c42923e12738 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:25.879551 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-9dcec964-7752-4eb0-8b72-c42923e12738 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 200 len: 1522 microversion: 2.1 time: 0.580417 Jun 30 10:02:25.888649 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 113/236] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:25 2022] GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 1522 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:25.935734 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-c649be32-8836-42a5-b2f4-ce72ef4389e6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:02:25.936299 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-c649be32-8836-42a5-b2f4-ce72ef4389e6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:25.942931 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c649be32-8836-42a5-b2f4-ce72ef4389e6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:25.944158 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c649be32-8836-42a5-b2f4-ce72ef4389e6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:25.945350 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c649be32-8836-42a5-b2f4-ce72ef4389e6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:25.946144 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c649be32-8836-42a5-b2f4-ce72ef4389e6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:25.971312 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.objects.instance [None req-c649be32-8836-42a5-b2f4-ce72ef4389e6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lazy-loading 'flavor' on Instance uuid 8c15c69f-e851-41aa-9f31-0e897b2f302d {{(pid=117846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:02:26.029601 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:02:28.477397 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-194c9c9e-16ea-4daa-94db-b610da57e6c0 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "POST /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.966720 Jun 30 10:02:28.478902 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 124/237] 10.222.0.16 () {60 vars in 1322 bytes} [Thu Jun 30 10:02:25 2022] POST /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160/os-volume_attachments => generated 194 bytes in 2969 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:02:28.492473 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-ff4111b8-9840-468f-8204-7a7427fabee8 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:28.493601 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-ff4111b8-9840-468f-8204-7a7427fabee8 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:28.501037 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ff4111b8-9840-468f-8204-7a7427fabee8 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:28.501804 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ff4111b8-9840-468f-8204-7a7427fabee8 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:28.502782 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ff4111b8-9840-468f-8204-7a7427fabee8 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:28.503438 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ff4111b8-9840-468f-8204-7a7427fabee8 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:28.765666 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-ff4111b8-9840-468f-8204-7a7427fabee8 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:28.778884 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-ff4111b8-9840-468f-8204-7a7427fabee8 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 200 len: 1522 microversion: 2.1 time: 0.292210 Jun 30 10:02:28.780113 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 125/238] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:28 2022] GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:28.831693 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-28da0b20-ad9a-4f40-9657-4ea8de42a578 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:28.832539 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-28da0b20-ad9a-4f40-9657-4ea8de42a578 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] [instance: 15d991f3-3759-4c65-87b1-0cdb8ed5fcd1] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:28.849016 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-28da0b20-ad9a-4f40-9657-4ea8de42a578 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:28.849457 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-28da0b20-ad9a-4f40-9657-4ea8de42a578 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:28.850223 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-28da0b20-ad9a-4f40-9657-4ea8de42a578 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:28.850643 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-28da0b20-ad9a-4f40-9657-4ea8de42a578 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:28.903142 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-28da0b20-ad9a-4f40-9657-4ea8de42a578 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] [instance: 15d991f3-3759-4c65-87b1-0cdb8ed5fcd1] Going to try to terminate instance {{(pid=117847) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 10:02:29.045755 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-28da0b20-ad9a-4f40-9657-4ea8de42a578 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] 10.222.0.16 "DELETE /compute/v2.1/servers/15d991f3-3759-4c65-87b1-0cdb8ed5fcd1" status: 204 len: 0 microversion: 2.1 time: 0.220049 Jun 30 10:02:29.047108 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 126/239] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 10:02:28 2022] DELETE /compute/v2.1/servers/15d991f3-3759-4c65-87b1-0cdb8ed5fcd1 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 30 10:02:29.065875 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-d9e880a8-16bf-4a07-b4e6-24c0093be3d5 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:29.067034 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-d9e880a8-16bf-4a07-b4e6-24c0093be3d5 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] [instance: 15d991f3-3759-4c65-87b1-0cdb8ed5fcd1] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:29.080037 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d9e880a8-16bf-4a07-b4e6-24c0093be3d5 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:29.080037 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d9e880a8-16bf-4a07-b4e6-24c0093be3d5 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:29.080037 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d9e880a8-16bf-4a07-b4e6-24c0093be3d5 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:29.094474 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d9e880a8-16bf-4a07-b4e6-24c0093be3d5 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:29.364080 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-d9e880a8-16bf-4a07-b4e6-24c0093be3d5 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fe0b9043ad479284163d04a90b842f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae600a17f9437d9e62475696c106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:29.372184 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-d9e880a8-16bf-4a07-b4e6-24c0093be3d5 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] 10.222.0.16 "GET /compute/v2.1/servers/15d991f3-3759-4c65-87b1-0cdb8ed5fcd1" status: 200 len: 1504 microversion: 2.1 time: 0.320088 Jun 30 10:02:29.372755 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 127/240] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:29 2022] GET /compute/v2.1/servers/15d991f3-3759-4c65-87b1-0cdb8ed5fcd1 => generated 1504 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:29.796611 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-5b0f4a5d-36b6-412d-a184-1378a0608e84 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:29.797954 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-5b0f4a5d-36b6-412d-a184-1378a0608e84 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:29.803700 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:02:29.805520 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-5b0f4a5d-36b6-412d-a184-1378a0608e84 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:29.806138 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-5b0f4a5d-36b6-412d-a184-1378a0608e84 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:29.806912 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-5b0f4a5d-36b6-412d-a184-1378a0608e84 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:29.807335 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-5b0f4a5d-36b6-412d-a184-1378a0608e84 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:30.025056 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-5b0f4a5d-36b6-412d-a184-1378a0608e84 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:30.037212 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-5b0f4a5d-36b6-412d-a184-1378a0608e84 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 200 len: 1522 microversion: 2.1 time: 0.244340 Jun 30 10:02:30.037797 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 128/241] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:29 2022] GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:30.090132 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-c649be32-8836-42a5-b2f4-ce72ef4389e6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "POST /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d/action" status: 202 len: 0 microversion: 2.20 time: 4.158066 Jun 30 10:02:30.095581 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 114/242] 10.222.0.16 () {62 vars in 1318 bytes} [Thu Jun 30 10:02:25 2022] POST /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d/action => generated 0 bytes in 4164 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 30 10:02:30.104345 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-9a9def5d-c512-4f97-98c2-4bdf4523c89e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:30.104964 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-9a9def5d-c512-4f97-98c2-4bdf4523c89e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:30.117309 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9a9def5d-c512-4f97-98c2-4bdf4523c89e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:30.118318 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9a9def5d-c512-4f97-98c2-4bdf4523c89e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:30.119228 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9a9def5d-c512-4f97-98c2-4bdf4523c89e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:30.119656 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9a9def5d-c512-4f97-98c2-4bdf4523c89e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:30.270636 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-9a9def5d-c512-4f97-98c2-4bdf4523c89e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:30.285481 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-9a9def5d-c512-4f97-98c2-4bdf4523c89e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:30.287645 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-9a9def5d-c512-4f97-98c2-4bdf4523c89e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:30.288917 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-9a9def5d-c512-4f97-98c2-4bdf4523c89e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1724 microversion: 2.20 time: 0.189519 Jun 30 10:02:30.300822 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 129/243] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:02:30 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:02:30.390929 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-cec2bd07-b829-4d58-bdbd-fe9e75586f18 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:30.391515 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-cec2bd07-b829-4d58-bdbd-fe9e75586f18 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] [instance: 15d991f3-3759-4c65-87b1-0cdb8ed5fcd1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:30.400451 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cec2bd07-b829-4d58-bdbd-fe9e75586f18 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:30.401202 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cec2bd07-b829-4d58-bdbd-fe9e75586f18 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:30.402135 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cec2bd07-b829-4d58-bdbd-fe9e75586f18 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:30.402559 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cec2bd07-b829-4d58-bdbd-fe9e75586f18 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:30.556734 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-cec2bd07-b829-4d58-bdbd-fe9e75586f18 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fe0b9043ad479284163d04a90b842f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae600a17f9437d9e62475696c106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:30.567016 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-cec2bd07-b829-4d58-bdbd-fe9e75586f18 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] 10.222.0.16 "GET /compute/v2.1/servers/15d991f3-3759-4c65-87b1-0cdb8ed5fcd1" status: 200 len: 1504 microversion: 2.1 time: 0.180352 Jun 30 10:02:30.567601 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 115/244] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:30 2022] GET /compute/v2.1/servers/15d991f3-3759-4c65-87b1-0cdb8ed5fcd1 => generated 1504 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:31.054164 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-5b5e8fad-ba23-47fb-a462-aaa2238ffa52 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:31.054766 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-5b5e8fad-ba23-47fb-a462-aaa2238ffa52 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:31.073268 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-5b5e8fad-ba23-47fb-a462-aaa2238ffa52 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:31.073715 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-5b5e8fad-ba23-47fb-a462-aaa2238ffa52 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:31.074493 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-5b5e8fad-ba23-47fb-a462-aaa2238ffa52 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:31.075106 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-5b5e8fad-ba23-47fb-a462-aaa2238ffa52 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:31.310990 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-952e7445-6c61-4246-8401-3dced3901660 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:31.311602 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-952e7445-6c61-4246-8401-3dced3901660 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:31.323065 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-952e7445-6c61-4246-8401-3dced3901660 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:31.323507 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-952e7445-6c61-4246-8401-3dced3901660 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:31.327663 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-952e7445-6c61-4246-8401-3dced3901660 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:31.330155 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-952e7445-6c61-4246-8401-3dced3901660 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:31.865586 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-5b5e8fad-ba23-47fb-a462-aaa2238ffa52 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:31.875276 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-5b5e8fad-ba23-47fb-a462-aaa2238ffa52 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 200 len: 1522 microversion: 2.1 time: 0.825042 Jun 30 10:02:31.875849 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 130/245] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:31 2022] GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 1522 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:31.893754 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-41a51fbb-d5db-47ed-ad09-f6634f04a8c7 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:31.895415 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-41a51fbb-d5db-47ed-ad09-f6634f04a8c7 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] [instance: 15d991f3-3759-4c65-87b1-0cdb8ed5fcd1] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:31.913745 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-41a51fbb-d5db-47ed-ad09-f6634f04a8c7 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:31.914492 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-41a51fbb-d5db-47ed-ad09-f6634f04a8c7 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:31.915564 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-41a51fbb-d5db-47ed-ad09-f6634f04a8c7 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:31.916506 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-41a51fbb-d5db-47ed-ad09-f6634f04a8c7 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:31.951995 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-952e7445-6c61-4246-8401-3dced3901660 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:31.969791 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-952e7445-6c61-4246-8401-3dced3901660 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:31.980331 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-952e7445-6c61-4246-8401-3dced3901660 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:31.981661 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-952e7445-6c61-4246-8401-3dced3901660 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1724 microversion: 2.20 time: 0.676942 Jun 30 10:02:31.993085 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 116/246] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:02:31 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1724 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:02:32.288118 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-41a51fbb-d5db-47ed-ad09-f6634f04a8c7 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fe0b9043ad479284163d04a90b842f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae600a17f9437d9e62475696c106ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:32.301024 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-41a51fbb-d5db-47ed-ad09-f6634f04a8c7 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] 10.222.0.16 "GET /compute/v2.1/servers/15d991f3-3759-4c65-87b1-0cdb8ed5fcd1" status: 200 len: 1504 microversion: 2.1 time: 0.418568 Jun 30 10:02:32.312712 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 131/247] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:31 2022] GET /compute/v2.1/servers/15d991f3-3759-4c65-87b1-0cdb8ed5fcd1 => generated 1504 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:32.503241 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-493d9f37-29f3-4cf6-85d4-d74c12608b8c req-a3e7669a-de03-47d3-8a8d-a535a0972dde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15d991f3-3759-4c65-87b1-0cdb8ed5fcd1", "name": "network-vif-deleted", "tag": "3ce65f37-4f96-48ff-bd11-9a8f93b338d9"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:02:32.513224 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-493d9f37-29f3-4cf6-85d4-d74c12608b8c req-a3e7669a-de03-47d3-8a8d-a535a0972dde service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:32.513640 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-493d9f37-29f3-4cf6-85d4-d74c12608b8c req-a3e7669a-de03-47d3-8a8d-a535a0972dde service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:32.527338 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-493d9f37-29f3-4cf6-85d4-d74c12608b8c req-a3e7669a-de03-47d3-8a8d-a535a0972dde service nova] Creating event network-vif-deleted:3ce65f37-4f96-48ff-bd11-9a8f93b338d9 for instance 15d991f3-3759-4c65-87b1-0cdb8ed5fcd1 on hv-cinder-84330 Jun 30 10:02:32.534476 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-493d9f37-29f3-4cf6-85d4-d74c12608b8c req-a3e7669a-de03-47d3-8a8d-a535a0972dde service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034511 Jun 30 10:02:32.535943 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 117/248] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:02:32.893098 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-5b9d6724-8e82-4f0f-a8e8-c9d0692ecc05 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:32.893698 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-5b9d6724-8e82-4f0f-a8e8-c9d0692ecc05 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:32.900501 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-5b9d6724-8e82-4f0f-a8e8-c9d0692ecc05 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:32.901142 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-5b9d6724-8e82-4f0f-a8e8-c9d0692ecc05 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:32.902032 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-5b9d6724-8e82-4f0f-a8e8-c9d0692ecc05 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:32.902575 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-5b9d6724-8e82-4f0f-a8e8-c9d0692ecc05 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:32.957497 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-15425270-bb72-4dee-88ef-3c596da5c981 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Action: 'create', calling method: .version_select at 0x7fc2204f1820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1062899002", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfc0NRFz1/EO7fSWqWalEZjiYtGCmWRH2fUk5HQIED0ObwvgvVWdO6tNXWdFzdC0CU2mc7S5LvGJCXqVatDB9tRqXE5SeLkcUHk5omyfucoZNp5bk6U/l2XsZpTUXt49g=="}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:02:32.979338 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-15425270-bb72-4dee-88ef-3c596da5c981 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Getting quotas for project d589375d668e413d839c63b0c3d4f104. Resources: {'key_pairs'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:02:32.983242 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-15425270-bb72-4dee-88ef-3c596da5c981 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Getting quotas for user aa782d84840842ef983ed058379d5626 and project d589375d668e413d839c63b0c3d4f104. Resources: {'key_pairs'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:02:33.026313 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-15425270-bb72-4dee-88ef-3c596da5c981 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.072998 Jun 30 10:02:33.027734 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 118/249] 10.222.0.16 () {60 vars in 1158 bytes} [Thu Jun 30 10:02:32 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:02:33.033348 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-9ad5840a-28d9-4253-ba56-95963a59cd41 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:33.034311 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-9ad5840a-28d9-4253-ba56-95963a59cd41 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:33.047399 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9ad5840a-28d9-4253-ba56-95963a59cd41 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:33.047711 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9ad5840a-28d9-4253-ba56-95963a59cd41 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:33.048510 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9ad5840a-28d9-4253-ba56-95963a59cd41 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:33.048927 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9ad5840a-28d9-4253-ba56-95963a59cd41 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:33.057607 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-5b9d6724-8e82-4f0f-a8e8-c9d0692ecc05 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:33.076247 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-5b9d6724-8e82-4f0f-a8e8-c9d0692ecc05 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 200 len: 1522 microversion: 2.1 time: 0.186832 Jun 30 10:02:33.077034 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 132/250] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:32 2022] GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:33.093957 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-1d233dc3-ec57-4e62-ad78-bb4baabca6d8 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-853247378", "imageRef": "947aa9a8-57f5-428d-a519-ee8b077711cf", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1062899002", "networks": [{"uuid": "40e07b80-504e-4a6a-ad64-f7933e1c00a5"}]}} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:02:33.152542 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.network.neutron [None req-1d233dc3-ec57-4e62-ad78-bb4baabca6d8 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] validate_networks() for [('40e07b80-504e-4a6a-ad64-f7933e1c00a5', None, None, None, None, None)] {{(pid=117847) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 10:02:33.277546 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-9ad5840a-28d9-4253-ba56-95963a59cd41 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:33.285729 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-9ad5840a-28d9-4253-ba56-95963a59cd41 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:33.287236 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-9ad5840a-28d9-4253-ba56-95963a59cd41 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:33.288521 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-9ad5840a-28d9-4253-ba56-95963a59cd41 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1724 microversion: 2.20 time: 0.259587 Jun 30 10:02:33.289168 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 119/251] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:02:33 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1724 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:02:33.323210 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e2771959-67df-4730-b2ed-414eb50b4bf9 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:33.323779 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-e2771959-67df-4730-b2ed-414eb50b4bf9 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] [instance: 15d991f3-3759-4c65-87b1-0cdb8ed5fcd1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:33.330547 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e2771959-67df-4730-b2ed-414eb50b4bf9 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:33.330990 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e2771959-67df-4730-b2ed-414eb50b4bf9 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:33.331818 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e2771959-67df-4730-b2ed-414eb50b4bf9 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:33.332278 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e2771959-67df-4730-b2ed-414eb50b4bf9 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:33.346521 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-e2771959-67df-4730-b2ed-414eb50b4bf9 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] HTTP exception thrown: Instance 15d991f3-3759-4c65-87b1-0cdb8ed5fcd1 could not be found. Jun 30 10:02:33.348205 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e2771959-67df-4730-b2ed-414eb50b4bf9 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Request method failure captured: Jun 30 10:02:33.348205 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: request: GET /compute/v2.1/servers/15d991f3-3759-4c65-87b1-0cdb8ed5fcd1 HTTP/1.1 Jun 30 10:02:33.348205 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept: application/json Jun 30 10:02:33.348205 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jun 30 10:02:33.348205 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Connection: close Jun 30 10:02:33.348205 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jun 30 10:02:33.348205 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jun 30 10:02:33.348205 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Host: 10.222.0.16 Jun 30 10:02:33.348205 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jun 30 10:02:33.348205 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jun 30 10:02:33.348205 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABivXSNjruwTweZl_VDrVhhWjYNIjUe2UCmuLL1cd6RSw36AXtZU5mhJw0-QY0DP8uXo-8Udi57dgrX2UqweHv1jisOqkGjBDpN9ka3tEBnb2oOy2JqUj65eLRbfNczNrbg9-4dl2_37GAFPMBmVn362kPMqZg3GvYJIyYgLrfI2yfsVWA Jun 30 10:02:33.348205 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jun 30 10:02:33.348205 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jun 30 10:02:33.348205 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jun 30 10:02:33.348205 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jun 30 10:02:33.348205 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jun 30 10:02:33.348205 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jun 30 10:02:33.348205 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Id: 46ae600a17f9437d9e62475696c106ca Jun 30 10:02:33.348205 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-VolumesActionsTest-1121760829 Jun 30 10:02:33.348205 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Role: reader,member Jun 30 10:02:33.348205 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Roles: reader,member Jun 30 10:02:33.349705 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/46ae600a17f9437d9e62475696c106ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/46ae600a17f9437d9e62475696c106ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/46ae600a17f9437d9e62475696c106ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_46ae600a17f9437d9e62475696c106ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:02:33.349705 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-VolumesActionsTest-1121760829 Jun 30 10:02:33.349705 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 46ae600a17f9437d9e62475696c106ca Jun 30 10:02:33.349705 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-VolumesActionsTest-1121760829 Jun 30 10:02:33.349705 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User: tempest-VolumesActionsTest-1121760829-project Jun 30 10:02:33.349705 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jun 30 10:02:33.349705 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jun 30 10:02:33.349705 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Id: 64fe0b9043ad479284163d04a90b842f Jun 30 10:02:33.349705 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-VolumesActionsTest-1121760829-project Jun 30 10:02:33.349705 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: method: > Jun 30 10:02:33.349705 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: exception: Instance 15d991f3-3759-4c65-87b1-0cdb8ed5fcd1 could not be found. Jun 30 10:02:33.349705 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: action_args: {'id': '15d991f3-3759-4c65-87b1-0cdb8ed5fcd1'} Jun 30 10:02:33.350555 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:02:33.350555 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:02:33.350555 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:02:33.350555 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:02:33.350555 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:02:33.350555 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:02:33.350555 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:02:33.350555 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:02:33.350555 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:02:33.350555 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:02:33.350555 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15d991f3-3759-4c65-87b1-0cdb8ed5fcd1 could not be found. Jun 30 10:02:33.350555 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:02:33.350555 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:02:33.350555 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:02:33.350555 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:02:33.350555 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:02:33.350555 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:02:33.350555 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:02:33.350555 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:02:33.350555 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:02:33.352015 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:02:33.352015 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:02:33.352015 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:02:33.352015 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:02:33.352015 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:02:33.352015 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:02:33.352015 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:02:33.352015 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15d991f3-3759-4c65-87b1-0cdb8ed5fcd1 could not be found. Jun 30 10:02:33.352015 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:02:33.352015 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:02:33.352015 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:02:33.352015 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:02:33.352015 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:02:33.352015 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:02:33.352015 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:02:33.352015 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:02:33.352015 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15d991f3-3759-4c65-87b1-0cdb8ed5fcd1 could not be found. Jun 30 10:02:33.352015 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:02:33.353220 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e2771959-67df-4730-b2ed-414eb50b4bf9 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] Returning 404 to user: Instance 15d991f3-3759-4c65-87b1-0cdb8ed5fcd1 could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:02:33.353220 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-e2771959-67df-4730-b2ed-414eb50b4bf9 tempest-VolumesActionsTest-1121760829 tempest-VolumesActionsTest-1121760829-project] 10.222.0.16 "GET /compute/v2.1/servers/15d991f3-3759-4c65-87b1-0cdb8ed5fcd1" status: 404 len: 111 microversion: 2.1 time: 0.031057 Jun 30 10:02:33.354695 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 120/252] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:33 2022] GET /compute/v2.1/servers/15d991f3-3759-4c65-87b1-0cdb8ed5fcd1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 30 10:02:33.592536 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-1d233dc3-ec57-4e62-ad78-bb4baabca6d8 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Flavor limits 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 10:02:33.593010 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-1d233dc3-ec57-4e62-ad78-bb4baabca6d8 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Image limits 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 10:02:33.593401 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-1d233dc3-ec57-4e62-ad78-bb4baabca6d8 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Flavor pref 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 10:02:33.593804 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-1d233dc3-ec57-4e62-ad78-bb4baabca6d8 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Image pref 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 10:02:33.594206 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-1d233dc3-ec57-4e62-ad78-bb4baabca6d8 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 10:02:33.603526 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1d233dc3-ec57-4e62-ad78-bb4baabca6d8 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:33.604109 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1d233dc3-ec57-4e62-ad78-bb4baabca6d8 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:33.605037 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1d233dc3-ec57-4e62-ad78-bb4baabca6d8 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:33.605531 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1d233dc3-ec57-4e62-ad78-bb4baabca6d8 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:33.623070 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.quota [None req-1d233dc3-ec57-4e62-ad78-bb4baabca6d8 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Getting quotas for project d589375d668e413d839c63b0c3d4f104. Resources: {'ram', 'instances', 'cores'} {{(pid=117847) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:02:33.627047 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.quota [None req-1d233dc3-ec57-4e62-ad78-bb4baabca6d8 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Getting quotas for user aa782d84840842ef983ed058379d5626 and project d589375d668e413d839c63b0c3d4f104. Resources: {'ram', 'instances', 'cores'} {{(pid=117847) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:02:33.638303 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-1d233dc3-ec57-4e62-ad78-bb4baabca6d8 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Going to run 1 instances... {{(pid=117847) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 10:02:33.640557 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-1d233dc3-ec57-4e62-ad78-bb4baabca6d8 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='947aa9a8-57f5-428d-a519-ee8b077711cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117847) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 10:02:33.697873 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-1d233dc3-ec57-4e62-ad78-bb4baabca6d8 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.607920 Jun 30 10:02:33.699315 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 133/253] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jun 30 10:02:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 30 10:02:33.710616 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-9b08dbd2-3d33-475b-8cd9-17fce50944ed tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:33.711682 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-9b08dbd2-3d33-475b-8cd9-17fce50944ed tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:33.778878 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-9b08dbd2-3d33-475b-8cd9-17fce50944ed tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:33.790564 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-9b08dbd2-3d33-475b-8cd9-17fce50944ed tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1258 microversion: 2.1 time: 0.082378 Jun 30 10:02:33.790564 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 121/254] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:33 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1258 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:34.096605 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-cdc44d3e-d868-4730-a7b6-367cdc5abaaa tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:34.097274 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-cdc44d3e-d868-4730-a7b6-367cdc5abaaa tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:34.104439 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-cdc44d3e-d868-4730-a7b6-367cdc5abaaa tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:34.105093 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-cdc44d3e-d868-4730-a7b6-367cdc5abaaa tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:34.105844 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-cdc44d3e-d868-4730-a7b6-367cdc5abaaa tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:34.106941 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-cdc44d3e-d868-4730-a7b6-367cdc5abaaa tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:34.257763 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-cdc44d3e-d868-4730-a7b6-367cdc5abaaa tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:34.266651 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-cdc44d3e-d868-4730-a7b6-367cdc5abaaa tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 200 len: 1522 microversion: 2.1 time: 0.174397 Jun 30 10:02:34.267834 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 134/255] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:34 2022] GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:34.306782 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-c36cf634-07fe-4b33-956c-f3c79dc1f9cd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:34.307464 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-c36cf634-07fe-4b33-956c-f3c79dc1f9cd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:34.313936 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c36cf634-07fe-4b33-956c-f3c79dc1f9cd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:34.314383 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c36cf634-07fe-4b33-956c-f3c79dc1f9cd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:34.315136 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c36cf634-07fe-4b33-956c-f3c79dc1f9cd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:34.315563 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c36cf634-07fe-4b33-956c-f3c79dc1f9cd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:34.450820 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-c36cf634-07fe-4b33-956c-f3c79dc1f9cd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:34.459454 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-c36cf634-07fe-4b33-956c-f3c79dc1f9cd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:34.461090 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-c36cf634-07fe-4b33-956c-f3c79dc1f9cd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:34.462248 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-c36cf634-07fe-4b33-956c-f3c79dc1f9cd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1724 microversion: 2.20 time: 0.159609 Jun 30 10:02:34.462780 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 122/256] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:02:34 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:02:34.806362 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-713a9fad-ad94-4f39-a75f-0608ccc47a39 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:34.807086 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-713a9fad-ad94-4f39-a75f-0608ccc47a39 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:34.813568 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-713a9fad-ad94-4f39-a75f-0608ccc47a39 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:34.814001 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-713a9fad-ad94-4f39-a75f-0608ccc47a39 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:34.814755 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-713a9fad-ad94-4f39-a75f-0608ccc47a39 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:34.815173 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-713a9fad-ad94-4f39-a75f-0608ccc47a39 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:34.820201 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:02:34.887699 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-713a9fad-ad94-4f39-a75f-0608ccc47a39 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:34.895641 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-713a9fad-ad94-4f39-a75f-0608ccc47a39 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1310 microversion: 2.1 time: 0.093445 Jun 30 10:02:34.896247 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 135/257] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:34 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1310 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:35.284727 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-6304e948-3e0c-498f-afd6-4e5e712073f2 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:35.285594 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-6304e948-3e0c-498f-afd6-4e5e712073f2 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:35.291985 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6304e948-3e0c-498f-afd6-4e5e712073f2 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:35.292394 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6304e948-3e0c-498f-afd6-4e5e712073f2 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:35.293334 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6304e948-3e0c-498f-afd6-4e5e712073f2 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:35.294044 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6304e948-3e0c-498f-afd6-4e5e712073f2 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:35.426793 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-6304e948-3e0c-498f-afd6-4e5e712073f2 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:35.435293 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-6304e948-3e0c-498f-afd6-4e5e712073f2 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 200 len: 1522 microversion: 2.1 time: 0.154415 Jun 30 10:02:35.435928 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 123/258] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:35 2022] GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:35.479901 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-d55771e3-40ec-4483-ab09-72119c03b1df tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:35.483732 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-d55771e3-40ec-4483-ab09-72119c03b1df tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:35.490743 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d55771e3-40ec-4483-ab09-72119c03b1df tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:35.491217 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d55771e3-40ec-4483-ab09-72119c03b1df tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:35.492014 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d55771e3-40ec-4483-ab09-72119c03b1df tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:35.492450 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d55771e3-40ec-4483-ab09-72119c03b1df tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:35.639577 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-d55771e3-40ec-4483-ab09-72119c03b1df tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:35.647570 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-d55771e3-40ec-4483-ab09-72119c03b1df tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:35.649113 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-d55771e3-40ec-4483-ab09-72119c03b1df tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:35.650349 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-d55771e3-40ec-4483-ab09-72119c03b1df tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1724 microversion: 2.20 time: 0.174423 Jun 30 10:02:35.651364 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 136/259] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:02:35 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:02:35.917292 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-4a5e29f4-b0bc-45dc-adfa-fd824202d5f9 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:35.917292 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-4a5e29f4-b0bc-45dc-adfa-fd824202d5f9 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:35.920995 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4a5e29f4-b0bc-45dc-adfa-fd824202d5f9 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:35.921439 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4a5e29f4-b0bc-45dc-adfa-fd824202d5f9 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:35.922217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4a5e29f4-b0bc-45dc-adfa-fd824202d5f9 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:35.922649 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4a5e29f4-b0bc-45dc-adfa-fd824202d5f9 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:36.011217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-4a5e29f4-b0bc-45dc-adfa-fd824202d5f9 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:36.024073 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-4a5e29f4-b0bc-45dc-adfa-fd824202d5f9 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1310 microversion: 2.1 time: 0.114990 Jun 30 10:02:36.025328 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 124/260] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:35 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1310 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:36.454201 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-772935bf-36cf-4e5b-b7e8-6ab62906f340 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:36.454201 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-772935bf-36cf-4e5b-b7e8-6ab62906f340 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:36.460433 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-772935bf-36cf-4e5b-b7e8-6ab62906f340 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:36.460836 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-772935bf-36cf-4e5b-b7e8-6ab62906f340 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:36.461607 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-772935bf-36cf-4e5b-b7e8-6ab62906f340 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:36.462058 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-772935bf-36cf-4e5b-b7e8-6ab62906f340 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:36.628799 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-772935bf-36cf-4e5b-b7e8-6ab62906f340 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:36.639781 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-772935bf-36cf-4e5b-b7e8-6ab62906f340 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 200 len: 1522 microversion: 2.1 time: 0.190316 Jun 30 10:02:36.640720 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 137/261] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:36 2022] GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:36.672751 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e8848925-f920-450a-8acd-88f059d280bd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:36.674675 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-e8848925-f920-450a-8acd-88f059d280bd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:36.677531 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:02:36.684942 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e8848925-f920-450a-8acd-88f059d280bd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:36.685387 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e8848925-f920-450a-8acd-88f059d280bd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:36.686485 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e8848925-f920-450a-8acd-88f059d280bd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:36.687075 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e8848925-f920-450a-8acd-88f059d280bd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:36.833702 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e8848925-f920-450a-8acd-88f059d280bd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:36.842239 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e8848925-f920-450a-8acd-88f059d280bd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:36.843863 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e8848925-f920-450a-8acd-88f059d280bd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:36.845225 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-e8848925-f920-450a-8acd-88f059d280bd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1724 microversion: 2.20 time: 0.179147 Jun 30 10:02:36.846093 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 125/262] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:02:36 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:02:37.041781 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-96564fc8-10f7-4d5d-8874-86a71d9b750a tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:37.042385 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-96564fc8-10f7-4d5d-8874-86a71d9b750a tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:37.048976 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-96564fc8-10f7-4d5d-8874-86a71d9b750a tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:37.049413 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-96564fc8-10f7-4d5d-8874-86a71d9b750a tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:37.050173 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-96564fc8-10f7-4d5d-8874-86a71d9b750a tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:37.050593 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-96564fc8-10f7-4d5d-8874-86a71d9b750a tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:37.115170 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-96564fc8-10f7-4d5d-8874-86a71d9b750a tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:37.122893 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-96564fc8-10f7-4d5d-8874-86a71d9b750a tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1310 microversion: 2.1 time: 0.085333 Jun 30 10:02:37.123473 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 138/263] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:37 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1310 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:37.657380 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ba8642f4-b909-4bbe-9485-901b3f5a098f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:37.657983 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-ba8642f4-b909-4bbe-9485-901b3f5a098f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:37.664612 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ba8642f4-b909-4bbe-9485-901b3f5a098f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:37.665070 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ba8642f4-b909-4bbe-9485-901b3f5a098f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:37.665827 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ba8642f4-b909-4bbe-9485-901b3f5a098f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:37.666260 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ba8642f4-b909-4bbe-9485-901b3f5a098f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:37.815697 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ba8642f4-b909-4bbe-9485-901b3f5a098f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:37.825560 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ba8642f4-b909-4bbe-9485-901b3f5a098f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 200 len: 1522 microversion: 2.1 time: 0.172131 Jun 30 10:02:37.826222 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 126/264] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:37 2022] GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:37.864473 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-c21b536f-bd24-475f-bd62-dfe082346c13 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:37.865127 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-c21b536f-bd24-475f-bd62-dfe082346c13 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:37.871888 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c21b536f-bd24-475f-bd62-dfe082346c13 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:37.872429 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c21b536f-bd24-475f-bd62-dfe082346c13 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:37.873257 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c21b536f-bd24-475f-bd62-dfe082346c13 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:37.873757 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c21b536f-bd24-475f-bd62-dfe082346c13 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:38.020124 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-c21b536f-bd24-475f-bd62-dfe082346c13 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:38.033536 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-c21b536f-bd24-475f-bd62-dfe082346c13 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:38.035493 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-c21b536f-bd24-475f-bd62-dfe082346c13 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:38.036715 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-c21b536f-bd24-475f-bd62-dfe082346c13 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1724 microversion: 2.20 time: 0.176166 Jun 30 10:02:38.037260 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 139/265] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:02:37 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:02:38.044037 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-60c50b97-3366-4f69-abcf-910196b65eb4 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1916413919", "imageRef": "c9dccba6-70d7-4aa8-9b8f-9c88ef1af443", "flavorRef": "452", "networks": [{"uuid": "105f04e0-7c25-4899-bcd0-828f74ca8a18"}]}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:02:38.112681 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.network.neutron [None req-60c50b97-3366-4f69-abcf-910196b65eb4 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] validate_networks() for [('105f04e0-7c25-4899-bcd0-828f74ca8a18', None, None, None, None, None)] {{(pid=117846) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 10:02:38.142486 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-b1f46826-c280-42e1-904f-906cdbcf95cb tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:38.145420 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-b1f46826-c280-42e1-904f-906cdbcf95cb tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:38.155217 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b1f46826-c280-42e1-904f-906cdbcf95cb tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:38.155740 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b1f46826-c280-42e1-904f-906cdbcf95cb tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:38.156653 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b1f46826-c280-42e1-904f-906cdbcf95cb tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:38.157083 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b1f46826-c280-42e1-904f-906cdbcf95cb tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:38.247263 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-b1f46826-c280-42e1-904f-906cdbcf95cb tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:38.256362 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-b1f46826-c280-42e1-904f-906cdbcf95cb tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1310 microversion: 2.1 time: 0.119356 Jun 30 10:02:38.257621 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 140/266] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:38 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1310 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:02:38.541566 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-60c50b97-3366-4f69-abcf-910196b65eb4 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Flavor limits 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 10:02:38.542449 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-60c50b97-3366-4f69-abcf-910196b65eb4 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Image limits 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 10:02:38.543398 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-60c50b97-3366-4f69-abcf-910196b65eb4 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Flavor pref 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 10:02:38.544154 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-60c50b97-3366-4f69-abcf-910196b65eb4 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Image pref 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 10:02:38.551155 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-60c50b97-3366-4f69-abcf-910196b65eb4 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 10:02:38.576400 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-60c50b97-3366-4f69-abcf-910196b65eb4 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:38.577266 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-60c50b97-3366-4f69-abcf-910196b65eb4 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:38.579320 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-60c50b97-3366-4f69-abcf-910196b65eb4 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:38.584356 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-60c50b97-3366-4f69-abcf-910196b65eb4 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:38.608715 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-60c50b97-3366-4f69-abcf-910196b65eb4 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Getting quotas for project 8de5ed099cad4e6aa38f12d16cfb9615. Resources: {'ram', 'instances', 'cores'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:02:38.613248 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-60c50b97-3366-4f69-abcf-910196b65eb4 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Getting quotas for user 957f396e32bc48c0866a53122122bc7a and project 8de5ed099cad4e6aa38f12d16cfb9615. Resources: {'ram', 'instances', 'cores'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:02:38.625922 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-60c50b97-3366-4f69-abcf-910196b65eb4 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Going to run 1 instances... {{(pid=117846) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 10:02:38.628700 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-60c50b97-3366-4f69-abcf-910196b65eb4 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 8e2cdb14-25e9-4273-9606-a2c458b4ebd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9dccba6-70d7-4aa8-9b8f-9c88ef1af443',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117846) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 10:02:38.678067 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-60c50b97-3366-4f69-abcf-910196b65eb4 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.643257 Jun 30 10:02:38.690851 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-d1e07c92-a549-46f8-8f27-d2fc655c1b34 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:38.692532 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-d1e07c92-a549-46f8-8f27-d2fc655c1b34 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 8e2cdb14-25e9-4273-9606-a2c458b4ebd2] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:38.696751 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 127/267] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jun 30 10:02:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 30 10:02:38.775265 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-d1e07c92-a549-46f8-8f27-d2fc655c1b34 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:38.790235 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-d1e07c92-a549-46f8-8f27-d2fc655c1b34 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2" status: 200 len: 1219 microversion: 2.1 time: 0.103427 Jun 30 10:02:38.801884 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 141/268] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:38 2022] GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2 => generated 1219 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:38.843470 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-1e564b42-7f88-450b-8007-1b8bf43636a4 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:38.844251 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-1e564b42-7f88-450b-8007-1b8bf43636a4 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:38.866160 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1e564b42-7f88-450b-8007-1b8bf43636a4 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:38.867678 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1e564b42-7f88-450b-8007-1b8bf43636a4 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:38.868938 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1e564b42-7f88-450b-8007-1b8bf43636a4 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:38.871765 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1e564b42-7f88-450b-8007-1b8bf43636a4 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:39.061213 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-45315bb4-3c19-4887-8130-584485d312f3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:39.062504 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-45315bb4-3c19-4887-8130-584485d312f3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:39.079624 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-45315bb4-3c19-4887-8130-584485d312f3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:39.080544 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-45315bb4-3c19-4887-8130-584485d312f3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:39.082990 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-45315bb4-3c19-4887-8130-584485d312f3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:39.084620 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-1e564b42-7f88-450b-8007-1b8bf43636a4 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:39.086181 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-45315bb4-3c19-4887-8130-584485d312f3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:39.099432 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-1e564b42-7f88-450b-8007-1b8bf43636a4 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 200 len: 1522 microversion: 2.1 time: 0.260377 Jun 30 10:02:39.123235 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 128/269] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:38 2022] GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:39.283137 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-cea609a2-6f1c-4814-9b57-c0c6ae972821 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:39.283748 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-cea609a2-6f1c-4814-9b57-c0c6ae972821 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:39.302353 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cea609a2-6f1c-4814-9b57-c0c6ae972821 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:39.304300 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cea609a2-6f1c-4814-9b57-c0c6ae972821 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:39.307721 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cea609a2-6f1c-4814-9b57-c0c6ae972821 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:39.309089 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cea609a2-6f1c-4814-9b57-c0c6ae972821 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:39.388668 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-45315bb4-3c19-4887-8130-584485d312f3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:39.405839 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-45315bb4-3c19-4887-8130-584485d312f3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:39.407615 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-45315bb4-3c19-4887-8130-584485d312f3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:39.409216 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-45315bb4-3c19-4887-8130-584485d312f3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1724 microversion: 2.20 time: 0.356406 Jun 30 10:02:39.409796 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 142/270] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:02:39 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1724 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:02:39.431483 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-cea609a2-6f1c-4814-9b57-c0c6ae972821 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:39.445567 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-cea609a2-6f1c-4814-9b57-c0c6ae972821 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1318 microversion: 2.1 time: 0.172346 Jun 30 10:02:39.446546 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 129/271] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:39 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:39.809925 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-0bb971a3-dbdb-4edc-bceb-854d351ef20c tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:39.810921 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-0bb971a3-dbdb-4edc-bceb-854d351ef20c tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 8e2cdb14-25e9-4273-9606-a2c458b4ebd2] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:39.817987 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-0bb971a3-dbdb-4edc-bceb-854d351ef20c tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:39.819085 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-0bb971a3-dbdb-4edc-bceb-854d351ef20c tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:39.820118 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-0bb971a3-dbdb-4edc-bceb-854d351ef20c tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:39.820554 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-0bb971a3-dbdb-4edc-bceb-854d351ef20c tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:39.884201 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-0bb971a3-dbdb-4edc-bceb-854d351ef20c tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:39.892983 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-0bb971a3-dbdb-4edc-bceb-854d351ef20c tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2" status: 200 len: 1223 microversion: 2.1 time: 0.087029 Jun 30 10:02:39.893789 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 143/272] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:39 2022] GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:40.117450 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-b952d204-3c3b-4a53-9f32-d0103668daae tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:40.118051 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-b952d204-3c3b-4a53-9f32-d0103668daae tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:40.126843 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b952d204-3c3b-4a53-9f32-d0103668daae tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:40.127287 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b952d204-3c3b-4a53-9f32-d0103668daae tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:40.128099 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b952d204-3c3b-4a53-9f32-d0103668daae tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:40.128531 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b952d204-3c3b-4a53-9f32-d0103668daae tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:40.330762 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-b952d204-3c3b-4a53-9f32-d0103668daae tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:40.339217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-b952d204-3c3b-4a53-9f32-d0103668daae tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 200 len: 1522 microversion: 2.1 time: 0.225798 Jun 30 10:02:40.340925 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 130/273] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:40 2022] GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:40.434399 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-627c0a2f-7f09-41cf-b63a-4d3069eb35ff tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:40.435033 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-627c0a2f-7f09-41cf-b63a-4d3069eb35ff tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:40.442190 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-627c0a2f-7f09-41cf-b63a-4d3069eb35ff tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:40.442639 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-627c0a2f-7f09-41cf-b63a-4d3069eb35ff tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:40.443763 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-627c0a2f-7f09-41cf-b63a-4d3069eb35ff tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:40.444323 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-627c0a2f-7f09-41cf-b63a-4d3069eb35ff tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:40.465372 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-bd30363d-5f56-4edf-bf0a-de9c6c2fa7e4 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:40.466577 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-bd30363d-5f56-4edf-bf0a-de9c6c2fa7e4 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:40.480452 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bd30363d-5f56-4edf-bf0a-de9c6c2fa7e4 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:40.480879 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bd30363d-5f56-4edf-bf0a-de9c6c2fa7e4 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:40.481835 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bd30363d-5f56-4edf-bf0a-de9c6c2fa7e4 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:40.482416 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bd30363d-5f56-4edf-bf0a-de9c6c2fa7e4 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:40.576978 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-bd30363d-5f56-4edf-bf0a-de9c6c2fa7e4 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:40.588073 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-bd30363d-5f56-4edf-bf0a-de9c6c2fa7e4 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1318 microversion: 2.1 time: 0.126845 Jun 30 10:02:40.598164 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 131/274] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:40 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1318 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:40.622985 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-627c0a2f-7f09-41cf-b63a-4d3069eb35ff tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:40.631911 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-627c0a2f-7f09-41cf-b63a-4d3069eb35ff tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:40.633642 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-627c0a2f-7f09-41cf-b63a-4d3069eb35ff tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:40.635003 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-627c0a2f-7f09-41cf-b63a-4d3069eb35ff tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1724 microversion: 2.20 time: 0.205157 Jun 30 10:02:40.645969 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 144/275] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:02:40 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:02:40.910202 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-eb49da23-6142-4bcb-bde2-92a409776cf9 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:40.910824 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-eb49da23-6142-4bcb-bde2-92a409776cf9 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 8e2cdb14-25e9-4273-9606-a2c458b4ebd2] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:40.918318 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-eb49da23-6142-4bcb-bde2-92a409776cf9 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:40.918894 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-eb49da23-6142-4bcb-bde2-92a409776cf9 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:40.919738 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-eb49da23-6142-4bcb-bde2-92a409776cf9 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:40.920257 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-eb49da23-6142-4bcb-bde2-92a409776cf9 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:41.013743 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-eb49da23-6142-4bcb-bde2-92a409776cf9 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:41.022592 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-eb49da23-6142-4bcb-bde2-92a409776cf9 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2" status: 200 len: 1223 microversion: 2.1 time: 0.116072 Jun 30 10:02:41.023450 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 132/276] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:40 2022] GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2 => generated 1223 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:41.357675 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-a05a5b24-aa6e-40b1-9c75-248074ed73b3 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:41.358363 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-a05a5b24-aa6e-40b1-9c75-248074ed73b3 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:41.366384 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a05a5b24-aa6e-40b1-9c75-248074ed73b3 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:41.366889 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a05a5b24-aa6e-40b1-9c75-248074ed73b3 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:41.367746 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a05a5b24-aa6e-40b1-9c75-248074ed73b3 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:41.368288 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a05a5b24-aa6e-40b1-9c75-248074ed73b3 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:41.530266 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-a05a5b24-aa6e-40b1-9c75-248074ed73b3 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:41.539801 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-a05a5b24-aa6e-40b1-9c75-248074ed73b3 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 200 len: 1522 microversion: 2.1 time: 0.185835 Jun 30 10:02:41.540633 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 145/277] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:41 2022] GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:41.606314 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-039eef1f-ba3c-4cef-ab91-0168a49922f1 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:41.607567 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-039eef1f-ba3c-4cef-ab91-0168a49922f1 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:41.614853 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-039eef1f-ba3c-4cef-ab91-0168a49922f1 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:41.615301 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-039eef1f-ba3c-4cef-ab91-0168a49922f1 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:41.618563 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-039eef1f-ba3c-4cef-ab91-0168a49922f1 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:41.619080 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-039eef1f-ba3c-4cef-ab91-0168a49922f1 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:41.655125 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-523a503e-1dee-4929-90db-8de71cd1f898 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:41.656240 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-523a503e-1dee-4929-90db-8de71cd1f898 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:41.663751 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-523a503e-1dee-4929-90db-8de71cd1f898 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:41.664440 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-523a503e-1dee-4929-90db-8de71cd1f898 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:41.665461 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-523a503e-1dee-4929-90db-8de71cd1f898 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:41.666221 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-523a503e-1dee-4929-90db-8de71cd1f898 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:41.770944 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-039eef1f-ba3c-4cef-ab91-0168a49922f1 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:41.786346 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-039eef1f-ba3c-4cef-ab91-0168a49922f1 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1318 microversion: 2.1 time: 0.184100 Jun 30 10:02:41.787270 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 133/278] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:41 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:42.042204 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-34d483e7-7e40-4929-8b32-05b616e79cd3 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:42.043138 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-34d483e7-7e40-4929-8b32-05b616e79cd3 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 8e2cdb14-25e9-4273-9606-a2c458b4ebd2] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:42.051201 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-34d483e7-7e40-4929-8b32-05b616e79cd3 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:42.052022 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-34d483e7-7e40-4929-8b32-05b616e79cd3 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:42.053112 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-34d483e7-7e40-4929-8b32-05b616e79cd3 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:42.054007 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-34d483e7-7e40-4929-8b32-05b616e79cd3 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:42.086485 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:02:42.100629 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-523a503e-1dee-4929-90db-8de71cd1f898 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:42.109034 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-523a503e-1dee-4929-90db-8de71cd1f898 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:42.110844 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-523a503e-1dee-4929-90db-8de71cd1f898 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:42.112163 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-523a503e-1dee-4929-90db-8de71cd1f898 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1724 microversion: 2.20 time: 0.462060 Jun 30 10:02:42.123757 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 146/279] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:02:41 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1724 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:02:42.149581 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-34d483e7-7e40-4929-8b32-05b616e79cd3 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:42.159112 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-34d483e7-7e40-4929-8b32-05b616e79cd3 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2" status: 200 len: 1271 microversion: 2.1 time: 0.121872 Jun 30 10:02:42.160272 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 134/280] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:42 2022] GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2 => generated 1271 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:42.558652 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-00b91f99-ba71-4828-9a2d-6dc6521a43c1 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:42.560210 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-00b91f99-ba71-4828-9a2d-6dc6521a43c1 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:42.583405 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-3ab40496-e1cd-4b2e-8a92-64be3cd6cb76 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Action: 'create', calling method: .version_select at 0x7fc2207181f0>, body: {"keypair": {"name": "tempest-keypair-1088680422", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwVAnDOiMqNbzL9aJy+r/TaGeZMqmVQxW+u94x/M8uqVeuwJEWfSJUrMWnHnCMdfSktGnfPV/jcbbXUq0SSv0wBwMPunQ4SdSQuuDRRTWs0+NNImfVlDvazFYz+4qwH9g=="}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:02:42.587278 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-00b91f99-ba71-4828-9a2d-6dc6521a43c1 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:42.587984 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-00b91f99-ba71-4828-9a2d-6dc6521a43c1 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:42.589002 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-00b91f99-ba71-4828-9a2d-6dc6521a43c1 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:42.589518 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-00b91f99-ba71-4828-9a2d-6dc6521a43c1 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:42.626363 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-3ab40496-e1cd-4b2e-8a92-64be3cd6cb76 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Getting quotas for project 2e55dd4580184f158efedbad5dc6e8fb. Resources: {'key_pairs'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:02:42.634907 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-3ab40496-e1cd-4b2e-8a92-64be3cd6cb76 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Getting quotas for user 4e9ad2c4909c49a6b3df8ece333e70b5 and project 2e55dd4580184f158efedbad5dc6e8fb. Resources: {'key_pairs'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:02:42.685732 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-3ab40496-e1cd-4b2e-8a92-64be3cd6cb76 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.104935 Jun 30 10:02:42.691496 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 135/281] 10.222.0.16 () {60 vars in 1158 bytes} [Thu Jun 30 10:02:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:02:42.807550 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-4869cf26-9755-41f1-9b0b-7cf079786252 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:42.808515 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-4869cf26-9755-41f1-9b0b-7cf079786252 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:42.822365 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4869cf26-9755-41f1-9b0b-7cf079786252 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:42.826990 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4869cf26-9755-41f1-9b0b-7cf079786252 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:42.830968 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4869cf26-9755-41f1-9b0b-7cf079786252 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:42.831798 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4869cf26-9755-41f1-9b0b-7cf079786252 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:42.952554 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-00b91f99-ba71-4828-9a2d-6dc6521a43c1 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:42.966644 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-00b91f99-ba71-4828-9a2d-6dc6521a43c1 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 200 len: 1522 microversion: 2.1 time: 0.411946 Jun 30 10:02:42.967250 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 147/282] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:42 2022] GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 1522 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:43.012284 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-4869cf26-9755-41f1-9b0b-7cf079786252 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:43.023662 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-4869cf26-9755-41f1-9b0b-7cf079786252 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1316 microversion: 2.1 time: 0.222111 Jun 30 10:02:43.028733 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 136/283] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:42 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1316 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:02:43.130533 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-e8a9fc2b-bbb8-4cbb-8899-70a6808ca087 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:43.131372 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-e8a9fc2b-bbb8-4cbb-8899-70a6808ca087 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:43.144495 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e8a9fc2b-bbb8-4cbb-8899-70a6808ca087 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:43.151552 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e8a9fc2b-bbb8-4cbb-8899-70a6808ca087 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:43.152724 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e8a9fc2b-bbb8-4cbb-8899-70a6808ca087 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:43.154930 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e8a9fc2b-bbb8-4cbb-8899-70a6808ca087 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:43.176974 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-34540175-15d2-42c7-bf8f-283505d20d96 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:43.177593 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-34540175-15d2-42c7-bf8f-283505d20d96 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 8e2cdb14-25e9-4273-9606-a2c458b4ebd2] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:43.186669 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-34540175-15d2-42c7-bf8f-283505d20d96 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:43.206201 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-34540175-15d2-42c7-bf8f-283505d20d96 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:43.207436 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-34540175-15d2-42c7-bf8f-283505d20d96 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:43.210550 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-34540175-15d2-42c7-bf8f-283505d20d96 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:43.490870 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-34540175-15d2-42c7-bf8f-283505d20d96 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:43.498762 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-34540175-15d2-42c7-bf8f-283505d20d96 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2" status: 200 len: 1289 microversion: 2.1 time: 0.325517 Jun 30 10:02:43.504280 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 137/284] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:43 2022] GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2 => generated 1289 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:02:43.561990 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-e8a9fc2b-bbb8-4cbb-8899-70a6808ca087 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:43.588640 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-e8a9fc2b-bbb8-4cbb-8899-70a6808ca087 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:43.600832 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-e8a9fc2b-bbb8-4cbb-8899-70a6808ca087 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:43.608633 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-e8a9fc2b-bbb8-4cbb-8899-70a6808ca087 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1724 microversion: 2.20 time: 0.476942 Jun 30 10:02:43.612373 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 148/285] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:02:43 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1724 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:02:43.988660 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-976f3e8e-331c-4381-b8af-e6f568b50f5b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:43.988660 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-976f3e8e-331c-4381-b8af-e6f568b50f5b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:44.002009 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-976f3e8e-331c-4381-b8af-e6f568b50f5b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:44.002470 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-976f3e8e-331c-4381-b8af-e6f568b50f5b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:44.003249 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-976f3e8e-331c-4381-b8af-e6f568b50f5b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:44.003713 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-976f3e8e-331c-4381-b8af-e6f568b50f5b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:44.046224 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-7d5c3c5e-a355-4089-a43b-216e60139488 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:44.046870 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-7d5c3c5e-a355-4089-a43b-216e60139488 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:44.049051 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell0:SELECT=2 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:02:44.058579 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7d5c3c5e-a355-4089-a43b-216e60139488 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:44.059531 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7d5c3c5e-a355-4089-a43b-216e60139488 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:44.060505 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7d5c3c5e-a355-4089-a43b-216e60139488 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:44.061301 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7d5c3c5e-a355-4089-a43b-216e60139488 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:44.394538 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-7d5c3c5e-a355-4089-a43b-216e60139488 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:44.414316 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-7d5c3c5e-a355-4089-a43b-216e60139488 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1316 microversion: 2.1 time: 0.362727 Jun 30 10:02:44.424919 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 149/286] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:44 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1316 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:44.515702 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-0cb8a817-9770-454c-9fa2-f3e3202a81bc tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:44.516625 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-0cb8a817-9770-454c-9fa2-f3e3202a81bc tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 8e2cdb14-25e9-4273-9606-a2c458b4ebd2] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:44.531005 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-0cb8a817-9770-454c-9fa2-f3e3202a81bc tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:44.531763 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-0cb8a817-9770-454c-9fa2-f3e3202a81bc tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:44.532774 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-0cb8a817-9770-454c-9fa2-f3e3202a81bc tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:44.533403 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-0cb8a817-9770-454c-9fa2-f3e3202a81bc tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:44.972244 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-976f3e8e-331c-4381-b8af-e6f568b50f5b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:44.989168 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-976f3e8e-331c-4381-b8af-e6f568b50f5b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 200 len: 1502 microversion: 2.1 time: 1.006602 Jun 30 10:02:45.000708 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 138/287] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:43 2022] GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 1502 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:45.006607 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-b5c63a9c-47e3-4d7b-99bf-1f2f09e48259 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:45.012679 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-b5c63a9c-47e3-4d7b-99bf-1f2f09e48259 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:45.022731 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b5c63a9c-47e3-4d7b-99bf-1f2f09e48259 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:45.036645 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b5c63a9c-47e3-4d7b-99bf-1f2f09e48259 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:45.037857 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b5c63a9c-47e3-4d7b-99bf-1f2f09e48259 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:45.038450 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b5c63a9c-47e3-4d7b-99bf-1f2f09e48259 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:45.063288 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-0cb8a817-9770-454c-9fa2-f3e3202a81bc tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:45.074074 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-0cb8a817-9770-454c-9fa2-f3e3202a81bc tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2" status: 200 len: 1277 microversion: 2.1 time: 0.562180 Jun 30 10:02:45.075239 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 150/288] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:44 2022] GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2 => generated 1277 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:45.087504 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-9bc7f7d3-b66f-42ee-bcee-3416efb501b3 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd5ea514-33a0-4fe8-a658-7b4678c10f4f"}} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:02:45.089007 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-9bc7f7d3-b66f-42ee-bcee-3416efb501b3 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:45.104485 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9bc7f7d3-b66f-42ee-bcee-3416efb501b3 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:45.105226 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9bc7f7d3-b66f-42ee-bcee-3416efb501b3 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:45.106523 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9bc7f7d3-b66f-42ee-bcee-3416efb501b3 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:45.107406 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9bc7f7d3-b66f-42ee-bcee-3416efb501b3 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:45.141465 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.wsgi [None req-9bc7f7d3-b66f-42ee-bcee-3416efb501b3 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] HTTP exception thrown: Cannot 'attach_volume' instance 3aa5453f-b4af-4817-a8d4-173f27d1cbd3 while it is in vm_state rescued Jun 30 10:02:45.144402 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-9bc7f7d3-b66f-42ee-bcee-3416efb501b3 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Request method failure captured: Jun 30 10:02:45.144402 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: request: POST /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3/os-volume_attachments HTTP/1.1 Jun 30 10:02:45.144402 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept: application/json Jun 30 10:02:45.144402 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept-Encoding: identity Jun 30 10:02:45.144402 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Connection: close Jun 30 10:02:45.144402 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Length: 74 Jun 30 10:02:45.144402 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Type: application/json Jun 30 10:02:45.144402 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Host: 10.222.0.16 Jun 30 10:02:45.144402 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Openstack-System-Scope: None Jun 30 10:02:45.144402 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: User-Agent: python-urllib3/1.26.9 Jun 30 10:02:45.144402 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Auth-Token: gAAAAABivXQ_-92o37DZs6KJkFkKOmwxkiwRqM5n-bwQzekE2akVqDN2T3UK3mXb5Q8vEgciD0-EZqDYHyMkNaHedrwR7kZ3VKOpjwe1q5N7_yLnQiQ9zWLbjXnQrmxPyI_YaSVtdEv4Ga6FaF9gEp45Vke44RdWPpPt0d1FP07cbOTc_eXjbzk Jun 30 10:02:45.144402 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Id: None Jun 30 10:02:45.144402 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Name: None Jun 30 10:02:45.144402 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Identity-Status: Confirmed Jun 30 10:02:45.144402 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Is-Admin-Project: True Jun 30 10:02:45.144402 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Id: default Jun 30 10:02:45.144402 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Name: Default Jun 30 10:02:45.144402 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Id: 0e8bc4e999ce4f1e9f52b456bcdd88d3 Jun 30 10:02:45.144402 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1274875426 Jun 30 10:02:45.144402 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Role: reader,member Jun 30 10:02:45.144402 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Roles: reader,member Jun 30 10:02:45.145951 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e8bc4e999ce4f1e9f52b456bcdd88d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0e8bc4e999ce4f1e9f52b456bcdd88d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e8bc4e999ce4f1e9f52b456bcdd88d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0e8bc4e999ce4f1e9f52b456bcdd88d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:02:45.145951 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1274875426 Jun 30 10:02:45.145951 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Id: 0e8bc4e999ce4f1e9f52b456bcdd88d3 Jun 30 10:02:45.145951 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1274875426 Jun 30 10:02:45.145951 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User: tempest-ServerRescueNegativeTestJSON-1274875426-project Jun 30 10:02:45.145951 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Id: default Jun 30 10:02:45.145951 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Name: Default Jun 30 10:02:45.145951 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Id: a179e34636ed4970be4f0790115f9d8f Jun 30 10:02:45.145951 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1274875426-project Jun 30 10:02:45.145951 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Jun 30 10:02:45.145951 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: {"volumeAttachment": {"volumeId": "bd5ea514-33a0-4fe8-a658-7b4678c10f4f"}} Jun 30 10:02:45.145951 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: method: > Jun 30 10:02:45.147239 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: exception: Cannot 'attach_volume' instance 3aa5453f-b4af-4817-a8d4-173f27d1cbd3 while it is in vm_state rescued Jun 30 10:02:45.147239 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: action_args: {'server_id': '3aa5453f-b4af-4817-a8d4-173f27d1cbd3', 'body': {'volumeAttachment': {'volumeId': 'bd5ea514-33a0-4fe8-a658-7b4678c10f4f'}}} Jun 30 10:02:45.147239 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:02:45.147239 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:02:45.147239 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 30 10:02:45.147239 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 30 10:02:45.147239 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 30 10:02:45.147239 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 30 10:02:45.147239 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 30 10:02:45.147239 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 30 10:02:45.147239 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3aa5453f-b4af-4817-a8d4-173f27d1cbd3 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 30 10:02:45.147239 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:02:45.147239 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:02:45.147239 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:02:45.147239 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:02:45.147239 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:02:45.147239 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:02:45.147239 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:02:45.147239 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:02:45.149062 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:02:45.149062 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:02:45.149062 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 10:02:45.149062 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 10:02:45.149062 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 10:02:45.149062 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 10:02:45.149062 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 10:02:45.149062 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 10:02:45.149062 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 30 10:02:45.149062 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 30 10:02:45.149062 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 30 10:02:45.149062 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 30 10:02:45.149062 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 3aa5453f-b4af-4817-a8d4-173f27d1cbd3 while it is in vm_state rescued Jun 30 10:02:45.149062 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:02:45.149062 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:02:45.149062 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:02:45.149062 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:02:45.149062 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:02:45.149062 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:02:45.150473 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:02:45.150473 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:02:45.150473 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 3aa5453f-b4af-4817-a8d4-173f27d1cbd3 while it is in vm_state rescued Jun 30 10:02:45.150473 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:02:45.151582 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-9bc7f7d3-b66f-42ee-bcee-3416efb501b3 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Returning 409 to user: Cannot 'attach_volume' instance 3aa5453f-b4af-4817-a8d4-173f27d1cbd3 while it is in vm_state rescued {{(pid=117847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:02:45.152625 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-9bc7f7d3-b66f-42ee-bcee-3416efb501b3 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "POST /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.073025 Jun 30 10:02:45.157127 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 151/289] 10.222.0.16 () {60 vars in 1322 bytes} [Thu Jun 30 10:02:45 2022] POST /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3/os-volume_attachments => generated 152 bytes in 81 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 30 10:02:45.165114 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-87b65309-0b4a-43aa-8176-421da20f93c6 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:02:45.166266 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-87b65309-0b4a-43aa-8176-421da20f93c6 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:45.173506 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-87b65309-0b4a-43aa-8176-421da20f93c6 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:45.174199 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-87b65309-0b4a-43aa-8176-421da20f93c6 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:45.175138 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-87b65309-0b4a-43aa-8176-421da20f93c6 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:45.175721 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-87b65309-0b4a-43aa-8176-421da20f93c6 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:45.261738 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell1:SELECT=100 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:02:45.309555 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-87b65309-0b4a-43aa-8176-421da20f93c6 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "POST /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3/action" status: 202 len: 0 microversion: 2.1 time: 0.150642 Jun 30 10:02:45.310313 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 152/290] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Jun 30 10:02:45 2022] POST /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:02:45.320319 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-8b38a554-35d0-40df-ba60-cc8e493d0c89 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:45.321325 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-8b38a554-35d0-40df-ba60-cc8e493d0c89 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:45.329282 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8b38a554-35d0-40df-ba60-cc8e493d0c89 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:45.329941 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8b38a554-35d0-40df-ba60-cc8e493d0c89 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:45.331992 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8b38a554-35d0-40df-ba60-cc8e493d0c89 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:45.332628 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8b38a554-35d0-40df-ba60-cc8e493d0c89 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:46.076013 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-b5c63a9c-47e3-4d7b-99bf-1f2f09e48259 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:46.091861 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-b5c63a9c-47e3-4d7b-99bf-1f2f09e48259 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:46.093686 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-b5c63a9c-47e3-4d7b-99bf-1f2f09e48259 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:46.100562 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-b5c63a9c-47e3-4d7b-99bf-1f2f09e48259 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1724 microversion: 2.20 time: 1.092527 Jun 30 10:02:46.101790 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 139/291] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:02:45 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1724 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:02:46.111454 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f398ae03-dd4e-445f-92ec-167160418616 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:46.113884 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f398ae03-dd4e-445f-92ec-167160418616 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:46.131141 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f398ae03-dd4e-445f-92ec-167160418616 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:46.131948 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f398ae03-dd4e-445f-92ec-167160418616 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:46.132938 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f398ae03-dd4e-445f-92ec-167160418616 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:46.134657 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f398ae03-dd4e-445f-92ec-167160418616 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:46.484051 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-8b38a554-35d0-40df-ba60-cc8e493d0c89 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:46.494541 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-8b38a554-35d0-40df-ba60-cc8e493d0c89 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 200 len: 1510 microversion: 2.1 time: 1.179023 Jun 30 10:02:46.507920 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 153/292] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:45 2022] GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 1510 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:46.520613 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-a5a2a824-dc36-4ce4-b884-832ea6481ed4 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-296694006", "imageRef": "c9dccba6-70d7-4aa8-9b8f-9c88ef1af443", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0141f079-f9f5-43fa-9ae7-09ea5e157c2e"}], "security_groups": [{"name": "tempest-securitygroup--481219201"}], "key_name": "tempest-keypair-1088680422", "user_data": "}} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:02:46.674943 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f398ae03-dd4e-445f-92ec-167160418616 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:46.692613 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f398ae03-dd4e-445f-92ec-167160418616 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1358 microversion: 2.1 time: 0.586838 Jun 30 10:02:46.704009 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 140/293] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:46 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1358 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:46.715318 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-0a12ebda-8498-449f-900e-8a48fc4eb4cf tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:46.716642 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-0a12ebda-8498-449f-900e-8a48fc4eb4cf tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 8e2cdb14-25e9-4273-9606-a2c458b4ebd2] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:46.734905 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0a12ebda-8498-449f-900e-8a48fc4eb4cf tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:46.735699 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0a12ebda-8498-449f-900e-8a48fc4eb4cf tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:46.736773 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0a12ebda-8498-449f-900e-8a48fc4eb4cf tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:46.737398 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0a12ebda-8498-449f-900e-8a48fc4eb4cf tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:46.884630 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-0a12ebda-8498-449f-900e-8a48fc4eb4cf tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:46.899577 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-0a12ebda-8498-449f-900e-8a48fc4eb4cf tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2" status: 200 len: 1277 microversion: 2.1 time: 0.194099 Jun 30 10:02:46.900545 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 141/294] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:46 2022] GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2 => generated 1277 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:47.118613 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-28f5150e-fc35-4d96-9fb4-d5da17794086 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:47.120099 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-28f5150e-fc35-4d96-9fb4-d5da17794086 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:47.133127 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-28f5150e-fc35-4d96-9fb4-d5da17794086 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:47.134838 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-28f5150e-fc35-4d96-9fb4-d5da17794086 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:47.135841 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-28f5150e-fc35-4d96-9fb4-d5da17794086 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:47.136280 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-28f5150e-fc35-4d96-9fb4-d5da17794086 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:47.508754 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-28f5150e-fc35-4d96-9fb4-d5da17794086 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:47.523387 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-28f5150e-fc35-4d96-9fb4-d5da17794086 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:47.525435 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-28f5150e-fc35-4d96-9fb4-d5da17794086 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:47.526859 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-28f5150e-fc35-4d96-9fb4-d5da17794086 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1724 microversion: 2.20 time: 0.412246 Jun 30 10:02:47.527650 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 142/295] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:02:47 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1724 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:02:47.543939 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-bf17a449-1a4f-478c-a02d-5d054236aa48 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:47.548585 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-bf17a449-1a4f-478c-a02d-5d054236aa48 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:47.561389 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bf17a449-1a4f-478c-a02d-5d054236aa48 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:47.562066 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bf17a449-1a4f-478c-a02d-5d054236aa48 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:47.562921 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bf17a449-1a4f-478c-a02d-5d054236aa48 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:47.563356 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bf17a449-1a4f-478c-a02d-5d054236aa48 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:47.767749 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-bf17a449-1a4f-478c-a02d-5d054236aa48 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:47.775649 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-bf17a449-1a4f-478c-a02d-5d054236aa48 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 200 len: 1510 microversion: 2.1 time: 0.237008 Jun 30 10:02:47.776351 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 143/296] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:47 2022] GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 1510 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:47.780873 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-c6d542b9-b306-4372-930f-17cf91e9ee26 req-06b7e0a8-dbf9-4668-9ee5-828eb2faef61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2766477-90ca-46bc-b411-a2d1b06b01be", "tag": "5b398ce3-4e1d-45ae-9288-26bcecde73b3"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:02:47.789458 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-c6d542b9-b306-4372-930f-17cf91e9ee26 req-06b7e0a8-dbf9-4668-9ee5-828eb2faef61 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:47.790036 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-c6d542b9-b306-4372-930f-17cf91e9ee26 req-06b7e0a8-dbf9-4668-9ee5-828eb2faef61 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:47.801839 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-c6d542b9-b306-4372-930f-17cf91e9ee26 req-06b7e0a8-dbf9-4668-9ee5-828eb2faef61 service nova] Creating event network-changed:5b398ce3-4e1d-45ae-9288-26bcecde73b3 for instance e2766477-90ca-46bc-b411-a2d1b06b01be on hv-cinder-84330 Jun 30 10:02:47.806954 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-c6d542b9-b306-4372-930f-17cf91e9ee26 req-06b7e0a8-dbf9-4668-9ee5-828eb2faef61 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029475 Jun 30 10:02:47.807552 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 144/297] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:02:47.812437 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-c9aa4254-b975-4290-a95a-b2558b1549d0 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:47.813109 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-c9aa4254-b975-4290-a95a-b2558b1549d0 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:47.819570 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c9aa4254-b975-4290-a95a-b2558b1549d0 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:47.820027 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c9aa4254-b975-4290-a95a-b2558b1549d0 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:47.820772 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c9aa4254-b975-4290-a95a-b2558b1549d0 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:47.821195 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c9aa4254-b975-4290-a95a-b2558b1549d0 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:47.951573 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-c9aa4254-b975-4290-a95a-b2558b1549d0 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:47.959543 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-c9aa4254-b975-4290-a95a-b2558b1549d0 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1358 microversion: 2.1 time: 0.150775 Jun 30 10:02:47.960269 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 145/298] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:47 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:47.964581 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-18f66fe2-f176-4da9-8c97-eb0f6a161fde tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:47.965204 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-18f66fe2-f176-4da9-8c97-eb0f6a161fde tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 8e2cdb14-25e9-4273-9606-a2c458b4ebd2] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:47.970931 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-18f66fe2-f176-4da9-8c97-eb0f6a161fde tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:47.971377 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-18f66fe2-f176-4da9-8c97-eb0f6a161fde tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:47.972154 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-18f66fe2-f176-4da9-8c97-eb0f6a161fde tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:47.972582 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-18f66fe2-f176-4da9-8c97-eb0f6a161fde tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:48.109234 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-18f66fe2-f176-4da9-8c97-eb0f6a161fde tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:48.117014 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-18f66fe2-f176-4da9-8c97-eb0f6a161fde tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2" status: 200 len: 1319 microversion: 2.1 time: 0.155799 Jun 30 10:02:48.117545 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 146/299] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:47 2022] GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:48.545761 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-652ff8ec-cc12-4bc1-871b-1d6341bfdd5a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:48.546485 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-652ff8ec-cc12-4bc1-871b-1d6341bfdd5a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:48.553174 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-652ff8ec-cc12-4bc1-871b-1d6341bfdd5a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:48.553614 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-652ff8ec-cc12-4bc1-871b-1d6341bfdd5a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:48.554364 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-652ff8ec-cc12-4bc1-871b-1d6341bfdd5a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:48.554785 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-652ff8ec-cc12-4bc1-871b-1d6341bfdd5a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:48.599085 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=2 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:02:48.701290 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-652ff8ec-cc12-4bc1-871b-1d6341bfdd5a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:48.710926 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-652ff8ec-cc12-4bc1-871b-1d6341bfdd5a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:48.713245 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-652ff8ec-cc12-4bc1-871b-1d6341bfdd5a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:48.714425 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-652ff8ec-cc12-4bc1-871b-1d6341bfdd5a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1724 microversion: 2.20 time: 0.172779 Jun 30 10:02:48.714984 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 147/300] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:02:48 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:02:48.782326 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell0:SELECT=8 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:02:48.793502 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-fe777192-e447-4df7-b2f7-02e053abb100 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:48.794176 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-fe777192-e447-4df7-b2f7-02e053abb100 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:48.800424 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fe777192-e447-4df7-b2f7-02e053abb100 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:48.800882 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fe777192-e447-4df7-b2f7-02e053abb100 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:48.801543 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fe777192-e447-4df7-b2f7-02e053abb100 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:48.801964 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fe777192-e447-4df7-b2f7-02e053abb100 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:48.958749 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-fe777192-e447-4df7-b2f7-02e053abb100 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:48.971399 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-fe777192-e447-4df7-b2f7-02e053abb100 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 200 len: 1510 microversion: 2.1 time: 0.180652 Jun 30 10:02:48.981060 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 148/301] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:48 2022] GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 1510 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:02:48.986297 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-6357d53b-b738-46f7-84b0-237a244ea796 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:48.986956 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-6357d53b-b738-46f7-84b0-237a244ea796 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:48.994204 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6357d53b-b738-46f7-84b0-237a244ea796 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:48.994646 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6357d53b-b738-46f7-84b0-237a244ea796 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:48.995522 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6357d53b-b738-46f7-84b0-237a244ea796 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:48.996042 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6357d53b-b738-46f7-84b0-237a244ea796 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:49.159901 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-6357d53b-b738-46f7-84b0-237a244ea796 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:49.168647 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-6357d53b-b738-46f7-84b0-237a244ea796 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1358 microversion: 2.1 time: 0.186501 Jun 30 10:02:49.169522 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 149/302] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:48 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:49.178077 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-19060f2b-8c9f-4707-aff6-21b9dca942c8 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:49.179031 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-19060f2b-8c9f-4707-aff6-21b9dca942c8 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 8e2cdb14-25e9-4273-9606-a2c458b4ebd2] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:49.185275 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-19060f2b-8c9f-4707-aff6-21b9dca942c8 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:49.185805 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-19060f2b-8c9f-4707-aff6-21b9dca942c8 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:49.186628 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-19060f2b-8c9f-4707-aff6-21b9dca942c8 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:49.187125 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-19060f2b-8c9f-4707-aff6-21b9dca942c8 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:49.351050 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-19060f2b-8c9f-4707-aff6-21b9dca942c8 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:49.359752 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-19060f2b-8c9f-4707-aff6-21b9dca942c8 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2" status: 200 len: 1319 microversion: 2.1 time: 0.188996 Jun 30 10:02:49.360383 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 150/303] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:49 2022] GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:49.734785 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-3441e038-88da-4221-8b0d-dcefefc57b98 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:49.735519 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-3441e038-88da-4221-8b0d-dcefefc57b98 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:49.743092 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3441e038-88da-4221-8b0d-dcefefc57b98 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:49.743617 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3441e038-88da-4221-8b0d-dcefefc57b98 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:49.744712 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3441e038-88da-4221-8b0d-dcefefc57b98 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:49.745219 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3441e038-88da-4221-8b0d-dcefefc57b98 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:49.931542 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-3441e038-88da-4221-8b0d-dcefefc57b98 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:49.940336 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-3441e038-88da-4221-8b0d-dcefefc57b98 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:49.942415 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-3441e038-88da-4221-8b0d-dcefefc57b98 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:49.944340 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-3441e038-88da-4221-8b0d-dcefefc57b98 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1724 microversion: 2.20 time: 0.213514 Jun 30 10:02:49.945536 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 151/304] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:02:49 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:02:49.989215 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-4de6c33c-9295-484b-a345-1fb80bec8ab5 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:49.989950 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-4de6c33c-9295-484b-a345-1fb80bec8ab5 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:49.996709 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4de6c33c-9295-484b-a345-1fb80bec8ab5 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:49.997099 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4de6c33c-9295-484b-a345-1fb80bec8ab5 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:49.997855 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4de6c33c-9295-484b-a345-1fb80bec8ab5 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:49.998277 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4de6c33c-9295-484b-a345-1fb80bec8ab5 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:50.235145 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-4de6c33c-9295-484b-a345-1fb80bec8ab5 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:50.238718 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=100 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:02:50.249654 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-4de6c33c-9295-484b-a345-1fb80bec8ab5 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 200 len: 1510 microversion: 2.1 time: 0.265140 Jun 30 10:02:50.250441 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 152/305] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:49 2022] GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 1510 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:02:50.260905 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-a1957ae0-43d9-4050-859c-77d862c50d81 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:50.261571 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-a1957ae0-43d9-4050-859c-77d862c50d81 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:50.284347 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a1957ae0-43d9-4050-859c-77d862c50d81 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:50.288995 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a1957ae0-43d9-4050-859c-77d862c50d81 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:50.290227 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a1957ae0-43d9-4050-859c-77d862c50d81 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:50.290885 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a1957ae0-43d9-4050-859c-77d862c50d81 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:50.509660 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-a1957ae0-43d9-4050-859c-77d862c50d81 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:50.539675 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-a1957ae0-43d9-4050-859c-77d862c50d81 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1358 microversion: 2.1 time: 0.288194 Jun 30 10:02:50.540892 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 153/306] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:50 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1358 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:50.546834 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-de384ca1-1143-47c9-97ca-e3a05a7f73c5 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:50.548298 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-de384ca1-1143-47c9-97ca-e3a05a7f73c5 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 8e2cdb14-25e9-4273-9606-a2c458b4ebd2] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:50.576907 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-de384ca1-1143-47c9-97ca-e3a05a7f73c5 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:50.579215 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-de384ca1-1143-47c9-97ca-e3a05a7f73c5 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:50.581152 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-de384ca1-1143-47c9-97ca-e3a05a7f73c5 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:50.581746 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-de384ca1-1143-47c9-97ca-e3a05a7f73c5 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:50.798966 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-de384ca1-1143-47c9-97ca-e3a05a7f73c5 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:50.816610 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-de384ca1-1143-47c9-97ca-e3a05a7f73c5 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2" status: 200 len: 1319 microversion: 2.1 time: 0.274395 Jun 30 10:02:50.818795 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 154/307] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:50 2022] GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2 => generated 1319 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:50.964063 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-fc0b69e5-5d1f-49ce-a3e9-1289dfc887fb tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:50.965008 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-fc0b69e5-5d1f-49ce-a3e9-1289dfc887fb tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:50.983931 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fc0b69e5-5d1f-49ce-a3e9-1289dfc887fb tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:50.984721 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fc0b69e5-5d1f-49ce-a3e9-1289dfc887fb tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:50.985724 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fc0b69e5-5d1f-49ce-a3e9-1289dfc887fb tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:50.986355 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fc0b69e5-5d1f-49ce-a3e9-1289dfc887fb tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:51.218322 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-fc0b69e5-5d1f-49ce-a3e9-1289dfc887fb tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:51.230791 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-fc0b69e5-5d1f-49ce-a3e9-1289dfc887fb tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:51.232710 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-fc0b69e5-5d1f-49ce-a3e9-1289dfc887fb tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:51.234585 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-fc0b69e5-5d1f-49ce-a3e9-1289dfc887fb tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1724 microversion: 2.20 time: 0.275298 Jun 30 10:02:51.235215 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 155/308] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:02:50 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1724 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:02:51.267279 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-9a863e7b-1560-4746-8309-aa094af6ddf0 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:51.268617 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-9a863e7b-1560-4746-8309-aa094af6ddf0 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:51.285609 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9a863e7b-1560-4746-8309-aa094af6ddf0 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:51.286057 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9a863e7b-1560-4746-8309-aa094af6ddf0 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:51.286861 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9a863e7b-1560-4746-8309-aa094af6ddf0 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:51.287593 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9a863e7b-1560-4746-8309-aa094af6ddf0 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:51.616628 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-9a863e7b-1560-4746-8309-aa094af6ddf0 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:51.625777 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-9a863e7b-1560-4746-8309-aa094af6ddf0 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 200 len: 1510 microversion: 2.1 time: 0.362549 Jun 30 10:02:51.626691 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 156/309] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:51 2022] GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 1510 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:02:51.631638 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-132aef5b-c7c0-4cc5-b95c-3def957783b2 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:51.632271 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-132aef5b-c7c0-4cc5-b95c-3def957783b2 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:51.638751 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-132aef5b-c7c0-4cc5-b95c-3def957783b2 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:51.639221 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-132aef5b-c7c0-4cc5-b95c-3def957783b2 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:51.640106 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-132aef5b-c7c0-4cc5-b95c-3def957783b2 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:51.640729 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-132aef5b-c7c0-4cc5-b95c-3def957783b2 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:51.910871 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-132aef5b-c7c0-4cc5-b95c-3def957783b2 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:51.922259 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-132aef5b-c7c0-4cc5-b95c-3def957783b2 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1358 microversion: 2.1 time: 0.294415 Jun 30 10:02:51.932702 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 157/310] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:51 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1358 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:51.941311 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-c2d633cf-9e30-4eba-bdf7-d9b96f4df342 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:51.951015 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-c2d633cf-9e30-4eba-bdf7-d9b96f4df342 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 8e2cdb14-25e9-4273-9606-a2c458b4ebd2] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:51.967380 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c2d633cf-9e30-4eba-bdf7-d9b96f4df342 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:51.967380 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c2d633cf-9e30-4eba-bdf7-d9b96f4df342 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:51.967380 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c2d633cf-9e30-4eba-bdf7-d9b96f4df342 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:51.967380 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c2d633cf-9e30-4eba-bdf7-d9b96f4df342 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:52.238259 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-c2d633cf-9e30-4eba-bdf7-d9b96f4df342 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:52.249259 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-c2d633cf-9e30-4eba-bdf7-d9b96f4df342 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2" status: 200 len: 1319 microversion: 2.1 time: 0.324493 Jun 30 10:02:52.250483 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 158/311] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:51 2022] GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2 => generated 1319 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:52.256358 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-aa82cd31-afdf-4547-9cd5-eca5110e57dd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:52.256988 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-aa82cd31-afdf-4547-9cd5-eca5110e57dd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:52.277656 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-aa82cd31-afdf-4547-9cd5-eca5110e57dd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:52.278107 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-aa82cd31-afdf-4547-9cd5-eca5110e57dd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:52.278913 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-aa82cd31-afdf-4547-9cd5-eca5110e57dd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:52.279349 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-aa82cd31-afdf-4547-9cd5-eca5110e57dd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:52.562855 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-aa82cd31-afdf-4547-9cd5-eca5110e57dd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:52.580698 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-aa82cd31-afdf-4547-9cd5-eca5110e57dd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:52.586601 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-aa82cd31-afdf-4547-9cd5-eca5110e57dd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:52.594145 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-aa82cd31-afdf-4547-9cd5-eca5110e57dd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1724 microversion: 2.20 time: 0.341781 Jun 30 10:02:52.600658 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 159/312] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:02:52 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1724 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:02:52.644897 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-2c37c630-130f-46c7-8bfe-2373f0d64b6d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:52.645532 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-2c37c630-130f-46c7-8bfe-2373f0d64b6d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:52.655394 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=16 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:02:52.657122 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2c37c630-130f-46c7-8bfe-2373f0d64b6d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:52.657731 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2c37c630-130f-46c7-8bfe-2373f0d64b6d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:52.659428 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2c37c630-130f-46c7-8bfe-2373f0d64b6d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:52.659942 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2c37c630-130f-46c7-8bfe-2373f0d64b6d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:52.875132 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-2c37c630-130f-46c7-8bfe-2373f0d64b6d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:52.887056 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-2c37c630-130f-46c7-8bfe-2373f0d64b6d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 200 len: 1510 microversion: 2.1 time: 0.246197 Jun 30 10:02:52.887659 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 160/313] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:52 2022] GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 1510 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:02:52.956162 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-61681c6c-ac01-4e23-ad97-3fef56fba59c tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:52.956162 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-61681c6c-ac01-4e23-ad97-3fef56fba59c tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:52.970144 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-61681c6c-ac01-4e23-ad97-3fef56fba59c tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:52.970792 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-61681c6c-ac01-4e23-ad97-3fef56fba59c tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:52.971726 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-61681c6c-ac01-4e23-ad97-3fef56fba59c tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:52.972581 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-61681c6c-ac01-4e23-ad97-3fef56fba59c tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:53.322660 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-61681c6c-ac01-4e23-ad97-3fef56fba59c tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:53.331094 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-61681c6c-ac01-4e23-ad97-3fef56fba59c tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1358 microversion: 2.1 time: 0.380275 Jun 30 10:02:53.331671 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 161/314] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:52 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1358 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:02:53.337345 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-8e626bc7-49d5-4047-9635-958ee5c367be tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:53.338011 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-8e626bc7-49d5-4047-9635-958ee5c367be tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 8e2cdb14-25e9-4273-9606-a2c458b4ebd2] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:53.345270 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8e626bc7-49d5-4047-9635-958ee5c367be tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:53.346180 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8e626bc7-49d5-4047-9635-958ee5c367be tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:53.347208 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8e626bc7-49d5-4047-9635-958ee5c367be tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:53.347898 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8e626bc7-49d5-4047-9635-958ee5c367be tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:53.555425 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-8e626bc7-49d5-4047-9635-958ee5c367be tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:53.565853 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-8e626bc7-49d5-4047-9635-958ee5c367be tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2" status: 200 len: 1319 microversion: 2.1 time: 0.232755 Jun 30 10:02:53.567081 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 162/315] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:53 2022] GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2 => generated 1319 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:53.619173 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-6fab0f9f-b8e1-45ca-a5d7-616934d25e76 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:53.620887 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-6fab0f9f-b8e1-45ca-a5d7-616934d25e76 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:53.630629 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:02:53.634825 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6fab0f9f-b8e1-45ca-a5d7-616934d25e76 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:53.635531 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6fab0f9f-b8e1-45ca-a5d7-616934d25e76 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:53.636594 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6fab0f9f-b8e1-45ca-a5d7-616934d25e76 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:53.637179 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6fab0f9f-b8e1-45ca-a5d7-616934d25e76 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:53.818639 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-6fab0f9f-b8e1-45ca-a5d7-616934d25e76 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:53.828309 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-6fab0f9f-b8e1-45ca-a5d7-616934d25e76 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:53.830003 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-6fab0f9f-b8e1-45ca-a5d7-616934d25e76 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:53.831367 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-6fab0f9f-b8e1-45ca-a5d7-616934d25e76 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1724 microversion: 2.20 time: 0.216587 Jun 30 10:02:53.831967 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 163/316] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:02:53 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:02:53.906221 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-9fe6db56-a827-4eb9-89eb-595ed02ab95e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:53.907042 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-9fe6db56-a827-4eb9-89eb-595ed02ab95e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:53.916215 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9fe6db56-a827-4eb9-89eb-595ed02ab95e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:53.916645 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9fe6db56-a827-4eb9-89eb-595ed02ab95e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:53.917568 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9fe6db56-a827-4eb9-89eb-595ed02ab95e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:53.918014 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9fe6db56-a827-4eb9-89eb-595ed02ab95e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:54.141301 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-9fe6db56-a827-4eb9-89eb-595ed02ab95e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:54.156647 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-9fe6db56-a827-4eb9-89eb-595ed02ab95e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 200 len: 1510 microversion: 2.1 time: 0.252145 Jun 30 10:02:54.157679 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 164/317] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:53 2022] GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 1510 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:54.353752 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ad44d3ef-af7d-4765-b474-3fff558b3d83 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:54.355798 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-ad44d3ef-af7d-4765-b474-3fff558b3d83 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:54.375958 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ad44d3ef-af7d-4765-b474-3fff558b3d83 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:54.385051 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ad44d3ef-af7d-4765-b474-3fff558b3d83 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:54.388851 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ad44d3ef-af7d-4765-b474-3fff558b3d83 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:54.389508 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ad44d3ef-af7d-4765-b474-3fff558b3d83 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:54.578506 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ad44d3ef-af7d-4765-b474-3fff558b3d83 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:54.590069 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ad44d3ef-af7d-4765-b474-3fff558b3d83 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1358 microversion: 2.1 time: 0.244697 Jun 30 10:02:54.590788 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 165/318] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:54 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1358 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:02:54.610665 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-0de27d9a-fd45-4b02-9889-9afc432b726d tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:54.611477 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-0de27d9a-fd45-4b02-9889-9afc432b726d tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 8e2cdb14-25e9-4273-9606-a2c458b4ebd2] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:54.620810 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0de27d9a-fd45-4b02-9889-9afc432b726d tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:54.622393 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0de27d9a-fd45-4b02-9889-9afc432b726d tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:54.623126 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0de27d9a-fd45-4b02-9889-9afc432b726d tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:54.623744 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0de27d9a-fd45-4b02-9889-9afc432b726d tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:55.709959 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-0de27d9a-fd45-4b02-9889-9afc432b726d tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:55.722706 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-0de27d9a-fd45-4b02-9889-9afc432b726d tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2" status: 200 len: 1319 microversion: 2.1 time: 1.117378 Jun 30 10:02:55.723571 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 166/319] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:54 2022] GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2 => generated 1319 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:55.744991 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-bf112e25-2503-4812-abc3-ece022e8b787 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:55.746047 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-bf112e25-2503-4812-abc3-ece022e8b787 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:55.762690 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bf112e25-2503-4812-abc3-ece022e8b787 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:55.765027 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bf112e25-2503-4812-abc3-ece022e8b787 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:55.766113 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bf112e25-2503-4812-abc3-ece022e8b787 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:55.768794 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bf112e25-2503-4812-abc3-ece022e8b787 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:56.411525 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-bf112e25-2503-4812-abc3-ece022e8b787 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:56.423738 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-bf112e25-2503-4812-abc3-ece022e8b787 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:56.425444 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-bf112e25-2503-4812-abc3-ece022e8b787 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:56.426697 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-bf112e25-2503-4812-abc3-ece022e8b787 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1745 microversion: 2.20 time: 0.692284 Jun 30 10:02:56.427465 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 167/320] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:02:55 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1745 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:02:56.439944 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-2043d792-9cd4-491f-83b2-6513d3294f49 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:56.440571 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-2043d792-9cd4-491f-83b2-6513d3294f49 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:56.456728 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2043d792-9cd4-491f-83b2-6513d3294f49 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:56.457096 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2043d792-9cd4-491f-83b2-6513d3294f49 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:56.457829 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2043d792-9cd4-491f-83b2-6513d3294f49 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:56.458264 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2043d792-9cd4-491f-83b2-6513d3294f49 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:56.494025 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=8,nova_cell1:INSERT=1 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:02:56.541305 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:02:56.851046 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-2043d792-9cd4-491f-83b2-6513d3294f49 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:56.861503 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-2043d792-9cd4-491f-83b2-6513d3294f49 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 200 len: 1510 microversion: 2.1 time: 0.433068 Jun 30 10:02:56.870815 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 168/321] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:56 2022] GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 1510 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:56.871463 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-2b41eade-b3f7-4c1d-ac34-fb0ab7ba0ebe tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:56.872102 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-2b41eade-b3f7-4c1d-ac34-fb0ab7ba0ebe tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:56.895650 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2b41eade-b3f7-4c1d-ac34-fb0ab7ba0ebe tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:56.896123 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2b41eade-b3f7-4c1d-ac34-fb0ab7ba0ebe tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:56.897043 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2b41eade-b3f7-4c1d-ac34-fb0ab7ba0ebe tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:56.897650 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2b41eade-b3f7-4c1d-ac34-fb0ab7ba0ebe tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:56.936696 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=100 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:02:57.274862 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-2b41eade-b3f7-4c1d-ac34-fb0ab7ba0ebe tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:57.286405 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-2b41eade-b3f7-4c1d-ac34-fb0ab7ba0ebe tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1358 microversion: 2.1 time: 0.421320 Jun 30 10:02:57.306498 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 169/322] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:56 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1358 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:57.311394 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f5be2731-f7c8-4f16-8e4f-a1e8e502022c tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:57.312023 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f5be2731-f7c8-4f16-8e4f-a1e8e502022c tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 8e2cdb14-25e9-4273-9606-a2c458b4ebd2] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:57.319790 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f5be2731-f7c8-4f16-8e4f-a1e8e502022c tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:57.320269 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f5be2731-f7c8-4f16-8e4f-a1e8e502022c tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:57.321060 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f5be2731-f7c8-4f16-8e4f-a1e8e502022c tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:57.321551 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f5be2731-f7c8-4f16-8e4f-a1e8e502022c tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:57.587917 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f5be2731-f7c8-4f16-8e4f-a1e8e502022c tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:57.596932 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f5be2731-f7c8-4f16-8e4f-a1e8e502022c tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2" status: 200 len: 1319 microversion: 2.1 time: 0.289344 Jun 30 10:02:57.597598 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 170/323] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:57 2022] GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2 => generated 1319 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:57.604996 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-7fe9e926-1af7-41f0-b408-c06f3cad002f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:57.605754 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-7fe9e926-1af7-41f0-b408-c06f3cad002f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:57.613879 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7fe9e926-1af7-41f0-b408-c06f3cad002f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:57.614698 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7fe9e926-1af7-41f0-b408-c06f3cad002f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:57.616153 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7fe9e926-1af7-41f0-b408-c06f3cad002f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:57.616773 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7fe9e926-1af7-41f0-b408-c06f3cad002f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:57.794757 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.network.neutron [None req-a5a2a824-dc36-4ce4-b884-832ea6481ed4 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] validate_networks() for [('0141f079-f9f5-43fa-9ae7-09ea5e157c2e', None, None, None, None, None)] {{(pid=117847) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 10:02:57.804078 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7fe9e926-1af7-41f0-b408-c06f3cad002f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:57.812424 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7fe9e926-1af7-41f0-b408-c06f3cad002f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:57.814038 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7fe9e926-1af7-41f0-b408-c06f3cad002f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:57.815346 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-7fe9e926-1af7-41f0-b408-c06f3cad002f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1745 microversion: 2.20 time: 0.216411 Jun 30 10:02:57.816177 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 171/324] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:02:57 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1745 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:02:57.822289 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-f33afcd3-ea86-4dbd-be58-1453ef306a61 req-97e1bc2e-7d43-485e-ab3d-094be19a02ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e2cdb14-25e9-4273-9606-a2c458b4ebd2", "tag": "64a7a6be-2b47-4c6f-9bc2-8e87a6042470"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:02:57.831861 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-f33afcd3-ea86-4dbd-be58-1453ef306a61 req-97e1bc2e-7d43-485e-ab3d-094be19a02ca service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:57.832541 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-f33afcd3-ea86-4dbd-be58-1453ef306a61 req-97e1bc2e-7d43-485e-ab3d-094be19a02ca service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:57.852635 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-f33afcd3-ea86-4dbd-be58-1453ef306a61 req-97e1bc2e-7d43-485e-ab3d-094be19a02ca service nova] Creating event network-changed:64a7a6be-2b47-4c6f-9bc2-8e87a6042470 for instance 8e2cdb14-25e9-4273-9606-a2c458b4ebd2 on hv-cinder-84330 Jun 30 10:02:57.858863 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-f33afcd3-ea86-4dbd-be58-1453ef306a61 req-97e1bc2e-7d43-485e-ab3d-094be19a02ca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041346 Jun 30 10:02:57.859449 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 172/325] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:02:57.879775 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-8886a4e3-0e02-4365-ad41-e3e0b19ea52d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:57.880374 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-8886a4e3-0e02-4365-ad41-e3e0b19ea52d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:57.887380 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8886a4e3-0e02-4365-ad41-e3e0b19ea52d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:57.888113 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8886a4e3-0e02-4365-ad41-e3e0b19ea52d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:57.889064 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8886a4e3-0e02-4365-ad41-e3e0b19ea52d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:57.889656 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8886a4e3-0e02-4365-ad41-e3e0b19ea52d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:58.094495 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-8886a4e3-0e02-4365-ad41-e3e0b19ea52d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:58.104086 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-8886a4e3-0e02-4365-ad41-e3e0b19ea52d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 200 len: 1510 microversion: 2.1 time: 0.229022 Jun 30 10:02:58.104962 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 173/326] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:57 2022] GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 1510 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:02:58.262864 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-a5a2a824-dc36-4ce4-b884-832ea6481ed4 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Flavor limits 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 10:02:58.263417 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-a5a2a824-dc36-4ce4-b884-832ea6481ed4 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Image limits 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 10:02:58.263901 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-a5a2a824-dc36-4ce4-b884-832ea6481ed4 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Flavor pref 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 10:02:58.264357 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-a5a2a824-dc36-4ce4-b884-832ea6481ed4 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Image pref 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 10:02:58.264771 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-a5a2a824-dc36-4ce4-b884-832ea6481ed4 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 10:02:58.274119 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a5a2a824-dc36-4ce4-b884-832ea6481ed4 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:58.274541 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a5a2a824-dc36-4ce4-b884-832ea6481ed4 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:58.275526 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a5a2a824-dc36-4ce4-b884-832ea6481ed4 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:58.276018 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a5a2a824-dc36-4ce4-b884-832ea6481ed4 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:58.294856 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.quota [None req-a5a2a824-dc36-4ce4-b884-832ea6481ed4 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Getting quotas for project 2e55dd4580184f158efedbad5dc6e8fb. Resources: {'ram', 'instances', 'cores'} {{(pid=117847) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:02:58.299855 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.quota [None req-a5a2a824-dc36-4ce4-b884-832ea6481ed4 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Getting quotas for user 4e9ad2c4909c49a6b3df8ece333e70b5 and project 2e55dd4580184f158efedbad5dc6e8fb. Resources: {'ram', 'instances', 'cores'} {{(pid=117847) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:02:58.311253 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-a5a2a824-dc36-4ce4-b884-832ea6481ed4 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Going to run 1 instances... {{(pid=117847) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 10:02:58.312538 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e5d60df2-fe30-49d6-8862-8157c252be90 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:58.313538 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-e5d60df2-fe30-49d6-8862-8157c252be90 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:58.313695 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-a5a2a824-dc36-4ce4-b884-832ea6481ed4 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 4223d53f-8e20-4343-9119-08cd7dfa6afe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9dccba6-70d7-4aa8-9b8f-9c88ef1af443',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117847) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 10:02:58.321092 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e5d60df2-fe30-49d6-8862-8157c252be90 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:58.321537 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e5d60df2-fe30-49d6-8862-8157c252be90 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:58.322292 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e5d60df2-fe30-49d6-8862-8157c252be90 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:58.322715 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e5d60df2-fe30-49d6-8862-8157c252be90 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:58.359734 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-a5a2a824-dc36-4ce4-b884-832ea6481ed4 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 11.853969 Jun 30 10:02:58.360443 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 154/327] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jun 30 10:02:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 11859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 10:02:58.381248 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-63dd33c9-90af-49eb-a906-de200db1f6c3 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:58.384229 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-63dd33c9-90af-49eb-a906-de200db1f6c3 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 4223d53f-8e20-4343-9119-08cd7dfa6afe] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:58.471543 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-63dd33c9-90af-49eb-a906-de200db1f6c3 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:58.478989 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-63dd33c9-90af-49eb-a906-de200db1f6c3 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe" status: 200 len: 1241 microversion: 2.1 time: 0.111318 Jun 30 10:02:58.483179 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 155/328] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:58 2022] GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe => generated 1241 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:02:58.616872 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-baa14fbd-300a-4dce-99ed-ee116b6ff7a4 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:58.617986 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-baa14fbd-300a-4dce-99ed-ee116b6ff7a4 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 8e2cdb14-25e9-4273-9606-a2c458b4ebd2] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:58.629012 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e5d60df2-fe30-49d6-8862-8157c252be90 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:58.655763 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-e5d60df2-fe30-49d6-8862-8157c252be90 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1358 microversion: 2.1 time: 0.343420 Jun 30 10:02:58.662210 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 174/329] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:58 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1358 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:02:58.666294 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-baa14fbd-300a-4dce-99ed-ee116b6ff7a4 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:58.668362 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-baa14fbd-300a-4dce-99ed-ee116b6ff7a4 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:58.669550 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-baa14fbd-300a-4dce-99ed-ee116b6ff7a4 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:58.671954 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-baa14fbd-300a-4dce-99ed-ee116b6ff7a4 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:58.837516 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ce78baa9-9d14-46dc-a8ea-3f1f95b399a4 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:58.844468 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-ce78baa9-9d14-46dc-a8ea-3f1f95b399a4 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:58.873960 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ce78baa9-9d14-46dc-a8ea-3f1f95b399a4 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:58.874679 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ce78baa9-9d14-46dc-a8ea-3f1f95b399a4 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:58.875311 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ce78baa9-9d14-46dc-a8ea-3f1f95b399a4 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:58.875600 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ce78baa9-9d14-46dc-a8ea-3f1f95b399a4 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:59.049089 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-baa14fbd-300a-4dce-99ed-ee116b6ff7a4 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:59.061271 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-baa14fbd-300a-4dce-99ed-ee116b6ff7a4 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2" status: 200 len: 1319 microversion: 2.1 time: 0.450628 Jun 30 10:02:59.070323 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 156/330] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:58 2022] GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2 => generated 1319 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:59.075245 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [req-348ab276-d451-4cc0-a732-5a13780c1bf3 req-c64f8e55-8f45-439d-ba39-5449ff7af9bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c15c69f-e851-41aa-9f31-0e897b2f302d", "name": "network-vif-plugged", "status": "completed", "tag": "c1be8ae5-cf30-4b83-be1b-6a94517a895b"}]} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:02:59.118494 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-348ab276-d451-4cc0-a732-5a13780c1bf3 req-c64f8e55-8f45-439d-ba39-5449ff7af9bb service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:59.119215 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-348ab276-d451-4cc0-a732-5a13780c1bf3 req-c64f8e55-8f45-439d-ba39-5449ff7af9bb service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:59.134753 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.compute.server_external_events [req-348ab276-d451-4cc0-a732-5a13780c1bf3 req-c64f8e55-8f45-439d-ba39-5449ff7af9bb service nova] Creating event network-vif-plugged:c1be8ae5-cf30-4b83-be1b-6a94517a895b for instance 8c15c69f-e851-41aa-9f31-0e897b2f302d on hv-cinder-84330 Jun 30 10:02:59.145844 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [req-348ab276-d451-4cc0-a732-5a13780c1bf3 req-c64f8e55-8f45-439d-ba39-5449ff7af9bb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073122 Jun 30 10:02:59.146450 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 157/331] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:02:59.156927 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-434c8720-8e89-46a7-9e5f-0a50ee106bc1 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:59.157959 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-434c8720-8e89-46a7-9e5f-0a50ee106bc1 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:59.170048 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-434c8720-8e89-46a7-9e5f-0a50ee106bc1 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:59.171593 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-434c8720-8e89-46a7-9e5f-0a50ee106bc1 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:59.172675 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-434c8720-8e89-46a7-9e5f-0a50ee106bc1 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:59.173386 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-434c8720-8e89-46a7-9e5f-0a50ee106bc1 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:59.177821 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ce78baa9-9d14-46dc-a8ea-3f1f95b399a4 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:59.189291 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ce78baa9-9d14-46dc-a8ea-3f1f95b399a4 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:59.193869 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ce78baa9-9d14-46dc-a8ea-3f1f95b399a4 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:59.195641 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ce78baa9-9d14-46dc-a8ea-3f1f95b399a4 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1745 microversion: 2.20 time: 0.364905 Jun 30 10:02:59.206562 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 175/332] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:02:58 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1745 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:02:59.334559 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-434c8720-8e89-46a7-9e5f-0a50ee106bc1 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:59.342584 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-434c8720-8e89-46a7-9e5f-0a50ee106bc1 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 200 len: 1510 microversion: 2.1 time: 0.194569 Jun 30 10:02:59.343138 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 158/333] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:59 2022] GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 1510 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:59.496318 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ba98869c-ccc9-4e89-b4ef-90a55d84e46e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:59.496917 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-ba98869c-ccc9-4e89-b4ef-90a55d84e46e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 4223d53f-8e20-4343-9119-08cd7dfa6afe] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:59.504983 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ba98869c-ccc9-4e89-b4ef-90a55d84e46e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:59.505400 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ba98869c-ccc9-4e89-b4ef-90a55d84e46e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:59.506187 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ba98869c-ccc9-4e89-b4ef-90a55d84e46e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:59.506846 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ba98869c-ccc9-4e89-b4ef-90a55d84e46e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:59.582512 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ba98869c-ccc9-4e89-b4ef-90a55d84e46e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:59.591917 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ba98869c-ccc9-4e89-b4ef-90a55d84e46e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe" status: 200 len: 1245 microversion: 2.1 time: 0.098215 Jun 30 10:02:59.599961 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 176/334] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:59 2022] GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe => generated 1245 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:02:59.680949 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-e7b4cf35-433e-48b4-81e3-d0d6e732533f tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:02:59.681988 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-e7b4cf35-433e-48b4-81e3-d0d6e732533f tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:02:59.690464 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e7b4cf35-433e-48b4-81e3-d0d6e732533f tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:59.690965 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e7b4cf35-433e-48b4-81e3-d0d6e732533f tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:59.691932 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e7b4cf35-433e-48b4-81e3-d0d6e732533f tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:02:59.692470 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e7b4cf35-433e-48b4-81e3-d0d6e732533f tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:02:59.827595 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-e7b4cf35-433e-48b4-81e3-d0d6e732533f tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:02:59.835398 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-e7b4cf35-433e-48b4-81e3-d0d6e732533f tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1358 microversion: 2.1 time: 0.159448 Jun 30 10:02:59.835949 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 159/335] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:02:59 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:00.084453 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-a1de1266-8eb6-437f-bafb-81b289ac13ec tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:00.085054 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-a1de1266-8eb6-437f-bafb-81b289ac13ec tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 8e2cdb14-25e9-4273-9606-a2c458b4ebd2] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:00.091298 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a1de1266-8eb6-437f-bafb-81b289ac13ec tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:00.091955 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a1de1266-8eb6-437f-bafb-81b289ac13ec tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:00.092897 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a1de1266-8eb6-437f-bafb-81b289ac13ec tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:00.093286 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a1de1266-8eb6-437f-bafb-81b289ac13ec tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:00.214700 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-f8f9987c-4429-4a43-9e5c-53d3e8ca95e1 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:00.215306 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-f8f9987c-4429-4a43-9e5c-53d3e8ca95e1 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:00.240103 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-f8f9987c-4429-4a43-9e5c-53d3e8ca95e1 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:00.240556 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-f8f9987c-4429-4a43-9e5c-53d3e8ca95e1 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:00.241360 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-f8f9987c-4429-4a43-9e5c-53d3e8ca95e1 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:00.241796 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-f8f9987c-4429-4a43-9e5c-53d3e8ca95e1 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:00.291061 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-a1de1266-8eb6-437f-bafb-81b289ac13ec tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:00.304482 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-a1de1266-8eb6-437f-bafb-81b289ac13ec tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2" status: 200 len: 1319 microversion: 2.1 time: 0.223413 Jun 30 10:03:00.315963 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 177/336] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:00 2022] GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2 => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:00.366725 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-86edec96-460f-4e0c-83dc-b2639282c27b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:00.375033 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-86edec96-460f-4e0c-83dc-b2639282c27b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:00.381571 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-86edec96-460f-4e0c-83dc-b2639282c27b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:00.382115 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-86edec96-460f-4e0c-83dc-b2639282c27b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:00.385328 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-86edec96-460f-4e0c-83dc-b2639282c27b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:00.386228 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-86edec96-460f-4e0c-83dc-b2639282c27b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:00.880928 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-f8f9987c-4429-4a43-9e5c-53d3e8ca95e1 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:00.893822 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-f8f9987c-4429-4a43-9e5c-53d3e8ca95e1 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:00.896078 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-f8f9987c-4429-4a43-9e5c-53d3e8ca95e1 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:00.897728 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-f8f9987c-4429-4a43-9e5c-53d3e8ca95e1 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1745 microversion: 2.20 time: 0.687219 Jun 30 10:03:00.911983 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 160/337] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:00 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1745 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:03:00.919144 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-069c7d7c-47b2-4093-900a-52887f7efa7b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:00.921864 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-069c7d7c-47b2-4093-900a-52887f7efa7b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 4223d53f-8e20-4343-9119-08cd7dfa6afe] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:00.937388 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-069c7d7c-47b2-4093-900a-52887f7efa7b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:00.938352 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-069c7d7c-47b2-4093-900a-52887f7efa7b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:00.939118 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-069c7d7c-47b2-4093-900a-52887f7efa7b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:00.940818 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-069c7d7c-47b2-4093-900a-52887f7efa7b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:01.110467 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-86edec96-460f-4e0c-83dc-b2639282c27b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:01.112712 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-069c7d7c-47b2-4093-900a-52887f7efa7b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:01.120254 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-86edec96-460f-4e0c-83dc-b2639282c27b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 200 len: 1516 microversion: 2.1 time: 0.762754 Jun 30 10:03:01.135344 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 178/338] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:00 2022] GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 1516 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:01.141313 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-069c7d7c-47b2-4093-900a-52887f7efa7b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe" status: 200 len: 1299 microversion: 2.1 time: 0.225105 Jun 30 10:03:01.145336 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e37a5c79-b8c1-494d-a0d1-659fd79d478e tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:01.148287 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-e37a5c79-b8c1-494d-a0d1-659fd79d478e tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:01.152863 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 161/339] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:00 2022] GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe => generated 1299 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:01.179882 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e37a5c79-b8c1-494d-a0d1-659fd79d478e tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:01.180350 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e37a5c79-b8c1-494d-a0d1-659fd79d478e tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:01.181140 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e37a5c79-b8c1-494d-a0d1-659fd79d478e tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:01.181568 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e37a5c79-b8c1-494d-a0d1-659fd79d478e tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:01.324019 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-c5028851-3194-494a-bc4c-1eb7e81a024e tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:01.324774 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-c5028851-3194-494a-bc4c-1eb7e81a024e tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 8e2cdb14-25e9-4273-9606-a2c458b4ebd2] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:01.333024 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c5028851-3194-494a-bc4c-1eb7e81a024e tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:01.334177 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c5028851-3194-494a-bc4c-1eb7e81a024e tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:01.335281 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c5028851-3194-494a-bc4c-1eb7e81a024e tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:01.349184 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c5028851-3194-494a-bc4c-1eb7e81a024e tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:01.539313 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e37a5c79-b8c1-494d-a0d1-659fd79d478e tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:01.548119 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-e37a5c79-b8c1-494d-a0d1-659fd79d478e tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1358 microversion: 2.1 time: 0.421362 Jun 30 10:03:01.550824 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 179/340] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:01 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1358 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:01.649975 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-c5028851-3194-494a-bc4c-1eb7e81a024e tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:01.657967 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-c5028851-3194-494a-bc4c-1eb7e81a024e tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2" status: 200 len: 1319 microversion: 2.1 time: 0.338712 Jun 30 10:03:01.658466 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 162/341] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:01 2022] GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2 => generated 1319 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:01.919593 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-4d0c3a09-c87c-43dd-bda6-fb933cc183fe tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:01.922695 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-4d0c3a09-c87c-43dd-bda6-fb933cc183fe tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:01.936555 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4d0c3a09-c87c-43dd-bda6-fb933cc183fe tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:01.937470 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4d0c3a09-c87c-43dd-bda6-fb933cc183fe tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:01.938886 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4d0c3a09-c87c-43dd-bda6-fb933cc183fe tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:01.939585 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4d0c3a09-c87c-43dd-bda6-fb933cc183fe tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:02.120630 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-4d0c3a09-c87c-43dd-bda6-fb933cc183fe tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:02.133325 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-4d0c3a09-c87c-43dd-bda6-fb933cc183fe tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:02.134850 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-4d0c3a09-c87c-43dd-bda6-fb933cc183fe tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:02.136101 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-4d0c3a09-c87c-43dd-bda6-fb933cc183fe tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1740 microversion: 2.20 time: 0.223795 Jun 30 10:03:02.147725 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 180/342] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:01 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1740 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:03:02.161034 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-811b1237-3bdc-4ee5-883d-e2b319b43c03 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:02.162163 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-811b1237-3bdc-4ee5-883d-e2b319b43c03 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 4223d53f-8e20-4343-9119-08cd7dfa6afe] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:02.171807 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-811b1237-3bdc-4ee5-883d-e2b319b43c03 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:02.172447 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-811b1237-3bdc-4ee5-883d-e2b319b43c03 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:02.173253 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-811b1237-3bdc-4ee5-883d-e2b319b43c03 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:02.173688 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-811b1237-3bdc-4ee5-883d-e2b319b43c03 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:02.249986 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-811b1237-3bdc-4ee5-883d-e2b319b43c03 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:02.258407 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-811b1237-3bdc-4ee5-883d-e2b319b43c03 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe" status: 200 len: 1299 microversion: 2.1 time: 0.102262 Jun 30 10:03:02.259300 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 163/343] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:02 2022] GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe => generated 1299 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:03:02.586161 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-4ab11a93-2c03-4426-aa9c-3c76aa7fb621 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:02.600917 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-4ab11a93-2c03-4426-aa9c-3c76aa7fb621 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:02.606927 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4ab11a93-2c03-4426-aa9c-3c76aa7fb621 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:02.608510 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4ab11a93-2c03-4426-aa9c-3c76aa7fb621 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:02.611430 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4ab11a93-2c03-4426-aa9c-3c76aa7fb621 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:02.615676 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4ab11a93-2c03-4426-aa9c-3c76aa7fb621 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:02.678697 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-0541f1ed-54df-4cc4-9211-ac88b08d589d tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:02.680156 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-0541f1ed-54df-4cc4-9211-ac88b08d589d tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 8e2cdb14-25e9-4273-9606-a2c458b4ebd2] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:02.687341 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-0541f1ed-54df-4cc4-9211-ac88b08d589d tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:02.687779 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-0541f1ed-54df-4cc4-9211-ac88b08d589d tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:02.688585 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-0541f1ed-54df-4cc4-9211-ac88b08d589d tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:02.689010 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-0541f1ed-54df-4cc4-9211-ac88b08d589d tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:03.324273 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-4ab11a93-2c03-4426-aa9c-3c76aa7fb621 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:03.333079 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-4ab11a93-2c03-4426-aa9c-3c76aa7fb621 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1358 microversion: 2.1 time: 0.753732 Jun 30 10:03:03.336032 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 181/344] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:02 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1358 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:03:03.345520 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-a13141dc-64bc-4da8-8650-31c00f08f7c2 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Action: 'create', calling method: .version_select at 0x7fc2204fa280>, body: {"keypair": {"name": "tempest-keypair-1971290745", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB17oLcm6jPuGnKbIjcuQ4qTcHkUr6YcST2iGNhPbXWg9hiaEkH812At9zUu5BTIZaBiNmHf3BChMFgq/eHVqhIUgWYsh8BEgoJohJtHYLedYYhPgIquYN9fgMeNvW8aKA=="}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:03:03.381411 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-a13141dc-64bc-4da8-8650-31c00f08f7c2 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Getting quotas for project 0e8bc4e999ce4f1e9f52b456bcdd88d3. Resources: {'key_pairs'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:03:03.386644 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-a13141dc-64bc-4da8-8650-31c00f08f7c2 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Getting quotas for user a179e34636ed4970be4f0790115f9d8f and project 0e8bc4e999ce4f1e9f52b456bcdd88d3. Resources: {'key_pairs'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:03:03.419475 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-a13141dc-64bc-4da8-8650-31c00f08f7c2 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.081693 Jun 30 10:03:03.421100 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 182/345] 10.222.0.16 () {60 vars in 1158 bytes} [Thu Jun 30 10:03:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:03:03.434994 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-8efa3ac4-73ed-4a77-a5d0-f55c6e425ed9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:03.435820 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-8efa3ac4-73ed-4a77-a5d0-f55c6e425ed9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:03.446517 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8efa3ac4-73ed-4a77-a5d0-f55c6e425ed9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:03.448388 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8efa3ac4-73ed-4a77-a5d0-f55c6e425ed9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:03.451556 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8efa3ac4-73ed-4a77-a5d0-f55c6e425ed9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:03.452135 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8efa3ac4-73ed-4a77-a5d0-f55c6e425ed9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:03.552975 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-0541f1ed-54df-4cc4-9211-ac88b08d589d tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:03.561509 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-0541f1ed-54df-4cc4-9211-ac88b08d589d tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2" status: 200 len: 1319 microversion: 2.1 time: 0.887909 Jun 30 10:03:03.575549 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 164/346] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:02 2022] GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2 => generated 1319 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:03.597941 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-c966f736-5ada-408b-a37c-6af92a33b8ca tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:03.599468 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-c966f736-5ada-408b-a37c-6af92a33b8ca tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 4223d53f-8e20-4343-9119-08cd7dfa6afe] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:03.616235 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c966f736-5ada-408b-a37c-6af92a33b8ca tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:03.616762 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c966f736-5ada-408b-a37c-6af92a33b8ca tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:03.620614 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c966f736-5ada-408b-a37c-6af92a33b8ca tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:03.621233 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c966f736-5ada-408b-a37c-6af92a33b8ca tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:03.971503 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-8efa3ac4-73ed-4a77-a5d0-f55c6e425ed9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:03.985069 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-8efa3ac4-73ed-4a77-a5d0-f55c6e425ed9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:03.992553 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-8efa3ac4-73ed-4a77-a5d0-f55c6e425ed9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:03.998726 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-8efa3ac4-73ed-4a77-a5d0-f55c6e425ed9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1740 microversion: 2.20 time: 0.576115 Jun 30 10:03:03.999312 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 183/347] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:03 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1740 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:03:04.027189 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-c966f736-5ada-408b-a37c-6af92a33b8ca tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:04.042066 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-c966f736-5ada-408b-a37c-6af92a33b8ca tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe" status: 200 len: 1366 microversion: 2.1 time: 0.457835 Jun 30 10:03:04.043406 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 165/348] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:03 2022] GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe => generated 1366 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:04.354709 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-1deccd01-249f-4b9f-a275-13c414a4fdf0 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:04.355937 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-1deccd01-249f-4b9f-a275-13c414a4fdf0 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:04.367507 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1deccd01-249f-4b9f-a275-13c414a4fdf0 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:04.367507 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1deccd01-249f-4b9f-a275-13c414a4fdf0 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:04.372443 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1deccd01-249f-4b9f-a275-13c414a4fdf0 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:04.373005 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1deccd01-249f-4b9f-a275-13c414a4fdf0 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:04.596450 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-66cb6fdb-b5a5-41a6-a363-e5a1b86dc522 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:04.597930 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-66cb6fdb-b5a5-41a6-a363-e5a1b86dc522 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 8e2cdb14-25e9-4273-9606-a2c458b4ebd2] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:04.613596 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-66cb6fdb-b5a5-41a6-a363-e5a1b86dc522 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:04.617320 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-66cb6fdb-b5a5-41a6-a363-e5a1b86dc522 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:04.620008 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-66cb6fdb-b5a5-41a6-a363-e5a1b86dc522 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:04.623023 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-66cb6fdb-b5a5-41a6-a363-e5a1b86dc522 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:05.105739 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-1deccd01-249f-4b9f-a275-13c414a4fdf0 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:05.116700 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-1deccd01-249f-4b9f-a275-13c414a4fdf0 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1358 microversion: 2.1 time: 0.766096 Jun 30 10:03:05.119332 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 184/349] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:04 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1358 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:05.130319 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-bb6c32f6-c28f-4dbf-b39a-033789352fc7 req-7392660c-4541-4d3a-aca2-252663087ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2766477-90ca-46bc-b411-a2d1b06b01be", "name": "network-vif-plugged", "status": "completed", "tag": "5b398ce3-4e1d-45ae-9288-26bcecde73b3"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:03:05.151159 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-bb6c32f6-c28f-4dbf-b39a-033789352fc7 req-7392660c-4541-4d3a-aca2-252663087ee5 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:05.153831 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-bb6c32f6-c28f-4dbf-b39a-033789352fc7 req-7392660c-4541-4d3a-aca2-252663087ee5 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:05.173559 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-bb6c32f6-c28f-4dbf-b39a-033789352fc7 req-7392660c-4541-4d3a-aca2-252663087ee5 service nova] Creating event network-vif-plugged:5b398ce3-4e1d-45ae-9288-26bcecde73b3 for instance e2766477-90ca-46bc-b411-a2d1b06b01be on hv-cinder-84330 Jun 30 10:03:05.179746 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-bb6c32f6-c28f-4dbf-b39a-033789352fc7 req-7392660c-4541-4d3a-aca2-252663087ee5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058700 Jun 30 10:03:05.180000 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-66cb6fdb-b5a5-41a6-a363-e5a1b86dc522 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:05.181563 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 185/350] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:03:05.189462 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-c901d59f-2e6a-4066-a5c7-463cbaf5fd7a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:05.190219 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-66cb6fdb-b5a5-41a6-a363-e5a1b86dc522 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2" status: 200 len: 1319 microversion: 2.1 time: 0.598307 Jun 30 10:03:05.190845 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-c901d59f-2e6a-4066-a5c7-463cbaf5fd7a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:05.201566 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c901d59f-2e6a-4066-a5c7-463cbaf5fd7a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:05.202281 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c901d59f-2e6a-4066-a5c7-463cbaf5fd7a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:05.203196 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c901d59f-2e6a-4066-a5c7-463cbaf5fd7a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:05.203771 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c901d59f-2e6a-4066-a5c7-463cbaf5fd7a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:05.204856 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 166/351] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:04 2022] GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2 => generated 1319 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:05.214385 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-a50d86ac-323e-4454-9976-d5e246433451 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:05.215258 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-a50d86ac-323e-4454-9976-d5e246433451 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 4223d53f-8e20-4343-9119-08cd7dfa6afe] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:05.224985 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a50d86ac-323e-4454-9976-d5e246433451 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:05.225456 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a50d86ac-323e-4454-9976-d5e246433451 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:05.226236 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a50d86ac-323e-4454-9976-d5e246433451 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:05.226672 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a50d86ac-323e-4454-9976-d5e246433451 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:05.950820 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-c901d59f-2e6a-4066-a5c7-463cbaf5fd7a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:05.968044 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-c901d59f-2e6a-4066-a5c7-463cbaf5fd7a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:05.974619 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-c901d59f-2e6a-4066-a5c7-463cbaf5fd7a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:05.977572 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-c901d59f-2e6a-4066-a5c7-463cbaf5fd7a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1740 microversion: 2.20 time: 0.791334 Jun 30 10:03:05.979790 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 186/352] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:05 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1740 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:03:06.050159 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-a50d86ac-323e-4454-9976-d5e246433451 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:06.080900 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-a50d86ac-323e-4454-9976-d5e246433451 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe" status: 200 len: 1366 microversion: 2.1 time: 0.869448 Jun 30 10:03:06.094231 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 167/353] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:05 2022] GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe => generated 1366 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:06.143697 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-210afbbf-4e81-45de-a611-7077e653d0a6 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:06.145778 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-210afbbf-4e81-45de-a611-7077e653d0a6 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:06.153926 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-210afbbf-4e81-45de-a611-7077e653d0a6 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:06.156851 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-210afbbf-4e81-45de-a611-7077e653d0a6 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:06.158277 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-210afbbf-4e81-45de-a611-7077e653d0a6 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:06.158913 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-210afbbf-4e81-45de-a611-7077e653d0a6 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:06.211747 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-c52ec6f8-836c-43ae-aa15-623d08774d84 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:06.212400 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-c52ec6f8-836c-43ae-aa15-623d08774d84 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 8e2cdb14-25e9-4273-9606-a2c458b4ebd2] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:06.229137 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c52ec6f8-836c-43ae-aa15-623d08774d84 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:06.229583 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c52ec6f8-836c-43ae-aa15-623d08774d84 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:06.236174 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c52ec6f8-836c-43ae-aa15-623d08774d84 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:06.237217 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c52ec6f8-836c-43ae-aa15-623d08774d84 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:06.699467 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-210afbbf-4e81-45de-a611-7077e653d0a6 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:06.709853 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-210afbbf-4e81-45de-a611-7077e653d0a6 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1358 microversion: 2.1 time: 0.579888 Jun 30 10:03:06.713000 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 187/354] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:06 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1358 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:06.776795 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-c52ec6f8-836c-43ae-aa15-623d08774d84 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:06.795729 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-c52ec6f8-836c-43ae-aa15-623d08774d84 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2" status: 200 len: 1319 microversion: 2.1 time: 0.590761 Jun 30 10:03:06.797041 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 168/355] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:06 2022] GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2 => generated 1319 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:03:06.999030 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-02887523-55cc-487b-91dc-fa8ca37be431 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:06.999647 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-02887523-55cc-487b-91dc-fa8ca37be431 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:07.008207 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-02887523-55cc-487b-91dc-fa8ca37be431 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:07.008663 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-02887523-55cc-487b-91dc-fa8ca37be431 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:07.009440 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-02887523-55cc-487b-91dc-fa8ca37be431 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:07.009876 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-02887523-55cc-487b-91dc-fa8ca37be431 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:07.074828 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=100 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:03:07.099799 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-f0867ecd-f027-4495-a706-2b14d37e2f8d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:07.101234 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-f0867ecd-f027-4495-a706-2b14d37e2f8d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 4223d53f-8e20-4343-9119-08cd7dfa6afe] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:07.109816 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-f0867ecd-f027-4495-a706-2b14d37e2f8d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:07.110529 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-f0867ecd-f027-4495-a706-2b14d37e2f8d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:07.111473 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-f0867ecd-f027-4495-a706-2b14d37e2f8d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:07.112090 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-f0867ecd-f027-4495-a706-2b14d37e2f8d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:07.427491 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-02887523-55cc-487b-91dc-fa8ca37be431 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:07.442158 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-02887523-55cc-487b-91dc-fa8ca37be431 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:07.444396 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-02887523-55cc-487b-91dc-fa8ca37be431 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:07.445823 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-02887523-55cc-487b-91dc-fa8ca37be431 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1740 microversion: 2.20 time: 0.452550 Jun 30 10:03:07.446565 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 188/356] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:06 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1740 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:03:07.460653 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-f0867ecd-f027-4495-a706-2b14d37e2f8d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:07.472578 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-f0867ecd-f027-4495-a706-2b14d37e2f8d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe" status: 200 len: 1366 microversion: 2.1 time: 0.376768 Jun 30 10:03:07.473393 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 169/357] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:07 2022] GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe => generated 1366 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:03:07.476543 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-6d921938-d7de-42b6-a283-9f19a42e01c7 req-134f9ef0-1957-4e8b-afaf-e2d40f7a332a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4223d53f-8e20-4343-9119-08cd7dfa6afe", "tag": "709dddb2-4ee5-4391-9682-278c94b807de"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:03:07.481555 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-7802e162-bf29-4fce-9876-f427d88b835a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1267016014", "imageRef": "c9dccba6-70d7-4aa8-9b8f-9c88ef1af443", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d5ea0eb7-1b8b-4933-8808-966ab8cd99e6"}], "security_groups": [{"name": "tempest-securitygroup--1334462064"}], "key_name": "tempest-keypair-1971290745", "user_data": "}} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:03:07.497718 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-6d921938-d7de-42b6-a283-9f19a42e01c7 req-134f9ef0-1957-4e8b-afaf-e2d40f7a332a service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:07.498399 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-6d921938-d7de-42b6-a283-9f19a42e01c7 req-134f9ef0-1957-4e8b-afaf-e2d40f7a332a service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:07.512917 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-6d921938-d7de-42b6-a283-9f19a42e01c7 req-134f9ef0-1957-4e8b-afaf-e2d40f7a332a service nova] Creating event network-changed:709dddb2-4ee5-4391-9682-278c94b807de for instance 4223d53f-8e20-4343-9119-08cd7dfa6afe on hv-cinder-84330 Jun 30 10:03:07.518295 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-6d921938-d7de-42b6-a283-9f19a42e01c7 req-134f9ef0-1957-4e8b-afaf-e2d40f7a332a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052550 Jun 30 10:03:07.522818 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 189/358] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:03:07.634378 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.network.neutron [None req-7802e162-bf29-4fce-9876-f427d88b835a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] validate_networks() for [('d5ea0eb7-1b8b-4933-8808-966ab8cd99e6', None, None, None, None, None)] {{(pid=117847) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 10:03:07.733015 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-01f03c3f-1632-41fc-b7b5-c46efdbeed11 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:07.734155 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-01f03c3f-1632-41fc-b7b5-c46efdbeed11 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:07.741326 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-01f03c3f-1632-41fc-b7b5-c46efdbeed11 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:07.742136 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-01f03c3f-1632-41fc-b7b5-c46efdbeed11 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:07.743134 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-01f03c3f-1632-41fc-b7b5-c46efdbeed11 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:07.743670 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-01f03c3f-1632-41fc-b7b5-c46efdbeed11 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:08.013086 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-01f03c3f-1632-41fc-b7b5-c46efdbeed11 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:08.022613 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-01f03c3f-1632-41fc-b7b5-c46efdbeed11 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1358 microversion: 2.1 time: 0.294845 Jun 30 10:03:08.023443 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 190/359] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:07 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1358 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:08.028765 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-b634de2f-8f07-40cf-9c4d-81b438d082bc tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:08.029728 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-b634de2f-8f07-40cf-9c4d-81b438d082bc tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 8e2cdb14-25e9-4273-9606-a2c458b4ebd2] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:08.036300 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b634de2f-8f07-40cf-9c4d-81b438d082bc tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:08.037016 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b634de2f-8f07-40cf-9c4d-81b438d082bc tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:08.037952 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b634de2f-8f07-40cf-9c4d-81b438d082bc tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:08.038532 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b634de2f-8f07-40cf-9c4d-81b438d082bc tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:08.232976 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-7802e162-bf29-4fce-9876-f427d88b835a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Flavor limits 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 10:03:08.233395 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-7802e162-bf29-4fce-9876-f427d88b835a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Image limits 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 10:03:08.233862 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-7802e162-bf29-4fce-9876-f427d88b835a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Flavor pref 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 10:03:08.234290 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-7802e162-bf29-4fce-9876-f427d88b835a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Image pref 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 10:03:08.234703 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-7802e162-bf29-4fce-9876-f427d88b835a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 10:03:08.254065 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7802e162-bf29-4fce-9876-f427d88b835a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:08.254821 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7802e162-bf29-4fce-9876-f427d88b835a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:08.255897 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7802e162-bf29-4fce-9876-f427d88b835a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:08.256514 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7802e162-bf29-4fce-9876-f427d88b835a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:08.266872 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-b634de2f-8f07-40cf-9c4d-81b438d082bc tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:08.280585 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-b634de2f-8f07-40cf-9c4d-81b438d082bc tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2" status: 200 len: 1319 microversion: 2.1 time: 0.254963 Jun 30 10:03:08.282202 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.quota [None req-7802e162-bf29-4fce-9876-f427d88b835a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Getting quotas for project 0e8bc4e999ce4f1e9f52b456bcdd88d3. Resources: {'ram', 'instances', 'cores'} {{(pid=117847) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:03:08.289852 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 191/360] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:08 2022] GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2 => generated 1319 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:08.292420 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.quota [None req-7802e162-bf29-4fce-9876-f427d88b835a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Getting quotas for user a179e34636ed4970be4f0790115f9d8f and project 0e8bc4e999ce4f1e9f52b456bcdd88d3. Resources: {'ram', 'instances', 'cores'} {{(pid=117847) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:03:08.307700 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-7802e162-bf29-4fce-9876-f427d88b835a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Going to run 1 instances... {{(pid=117847) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 10:03:08.310113 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-7802e162-bf29-4fce-9876-f427d88b835a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9dccba6-70d7-4aa8-9b8f-9c88ef1af443',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117847) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 10:03:08.374962 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-7802e162-bf29-4fce-9876-f427d88b835a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.900249 Jun 30 10:03:08.375603 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 170/361] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jun 30 10:03:07 2022] POST /compute/v2.1/servers => generated 409 bytes in 901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 10:03:08.387119 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-a6558a19-6b7f-405c-ba57-0edb61619fcf tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:08.388037 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-a6558a19-6b7f-405c-ba57-0edb61619fcf tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:08.469022 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-ac36a4fd-c481-4373-9c50-09b1d3445f2c tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:08.469633 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-ac36a4fd-c481-4373-9c50-09b1d3445f2c tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:08.502623 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-a6558a19-6b7f-405c-ba57-0edb61619fcf tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:08.505795 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ac36a4fd-c481-4373-9c50-09b1d3445f2c tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:08.506637 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ac36a4fd-c481-4373-9c50-09b1d3445f2c tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:08.507589 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ac36a4fd-c481-4373-9c50-09b1d3445f2c tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:08.508209 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ac36a4fd-c481-4373-9c50-09b1d3445f2c tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:08.511208 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-a6558a19-6b7f-405c-ba57-0edb61619fcf tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1246 microversion: 2.1 time: 0.128529 Jun 30 10:03:08.512359 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 192/362] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:08 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1246 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:08.517491 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-942d420c-2036-487c-89fa-4b8a53d2602c tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:08.518275 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-942d420c-2036-487c-89fa-4b8a53d2602c tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 4223d53f-8e20-4343-9119-08cd7dfa6afe] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:08.524809 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-942d420c-2036-487c-89fa-4b8a53d2602c tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:08.525496 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-942d420c-2036-487c-89fa-4b8a53d2602c tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:08.526431 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-942d420c-2036-487c-89fa-4b8a53d2602c tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:08.527020 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-942d420c-2036-487c-89fa-4b8a53d2602c tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:08.805232 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-ac36a4fd-c481-4373-9c50-09b1d3445f2c tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:08.815847 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-942d420c-2036-487c-89fa-4b8a53d2602c tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:08.826785 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-ac36a4fd-c481-4373-9c50-09b1d3445f2c tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:08.830906 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-942d420c-2036-487c-89fa-4b8a53d2602c tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe" status: 200 len: 1366 microversion: 2.1 time: 0.317239 Jun 30 10:03:08.831680 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 193/363] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:08 2022] GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe => generated 1366 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:08.833703 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-ac36a4fd-c481-4373-9c50-09b1d3445f2c tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:08.835322 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-ac36a4fd-c481-4373-9c50-09b1d3445f2c tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1740 microversion: 2.20 time: 0.374493 Jun 30 10:03:08.846228 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 171/364] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:08 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1740 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:03:09.040608 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-331eeacc-3d3d-46af-959f-044843d2b2bd tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:09.041877 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-331eeacc-3d3d-46af-959f-044843d2b2bd tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:09.054471 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-331eeacc-3d3d-46af-959f-044843d2b2bd tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:09.055723 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-331eeacc-3d3d-46af-959f-044843d2b2bd tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:09.058114 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-331eeacc-3d3d-46af-959f-044843d2b2bd tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:09.058548 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-331eeacc-3d3d-46af-959f-044843d2b2bd tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:09.208511 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-331eeacc-3d3d-46af-959f-044843d2b2bd tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:09.217062 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-331eeacc-3d3d-46af-959f-044843d2b2bd tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1358 microversion: 2.1 time: 0.180931 Jun 30 10:03:09.217658 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 194/365] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:09 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:09.301046 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-3b95d063-6cf7-4883-9415-27649b599344 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:09.301699 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-3b95d063-6cf7-4883-9415-27649b599344 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 8e2cdb14-25e9-4273-9606-a2c458b4ebd2] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:09.308925 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3b95d063-6cf7-4883-9415-27649b599344 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:09.309366 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3b95d063-6cf7-4883-9415-27649b599344 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:09.310130 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3b95d063-6cf7-4883-9415-27649b599344 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:09.310557 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3b95d063-6cf7-4883-9415-27649b599344 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:09.494305 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-3b95d063-6cf7-4883-9415-27649b599344 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:09.520129 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-3b95d063-6cf7-4883-9415-27649b599344 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2" status: 200 len: 1319 microversion: 2.1 time: 0.223001 Jun 30 10:03:09.520778 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 172/366] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:09 2022] GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:09.530192 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-c4356626-4580-4f94-ad9e-68d0320a9200 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:09.531341 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-c4356626-4580-4f94-ad9e-68d0320a9200 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:09.538496 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c4356626-4580-4f94-ad9e-68d0320a9200 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:09.539837 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c4356626-4580-4f94-ad9e-68d0320a9200 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:09.540873 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c4356626-4580-4f94-ad9e-68d0320a9200 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:09.541629 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c4356626-4580-4f94-ad9e-68d0320a9200 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:09.636273 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-c4356626-4580-4f94-ad9e-68d0320a9200 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:09.655828 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-c4356626-4580-4f94-ad9e-68d0320a9200 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1242 microversion: 2.1 time: 0.130271 Jun 30 10:03:09.668032 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 195/367] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:09 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1242 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:09.850445 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-6710d6ba-2614-4c7c-ab0a-a475c31da79e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:09.851635 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-6710d6ba-2614-4c7c-ab0a-a475c31da79e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 4223d53f-8e20-4343-9119-08cd7dfa6afe] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:09.856786 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-c648bf2d-b5fb-4b32-b9d2-a3abfb2fa12b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:09.857400 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-c648bf2d-b5fb-4b32-b9d2-a3abfb2fa12b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:09.860211 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-6710d6ba-2614-4c7c-ab0a-a475c31da79e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:09.860918 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-6710d6ba-2614-4c7c-ab0a-a475c31da79e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:09.861914 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-6710d6ba-2614-4c7c-ab0a-a475c31da79e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:09.862576 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-6710d6ba-2614-4c7c-ab0a-a475c31da79e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:09.879803 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c648bf2d-b5fb-4b32-b9d2-a3abfb2fa12b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:09.884529 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c648bf2d-b5fb-4b32-b9d2-a3abfb2fa12b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:09.885395 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c648bf2d-b5fb-4b32-b9d2-a3abfb2fa12b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:09.885983 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c648bf2d-b5fb-4b32-b9d2-a3abfb2fa12b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:09.888948 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell1:SELECT=100 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:03:10.088603 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-6710d6ba-2614-4c7c-ab0a-a475c31da79e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:10.101600 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-6710d6ba-2614-4c7c-ab0a-a475c31da79e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe" status: 200 len: 1366 microversion: 2.1 time: 0.257357 Jun 30 10:03:10.103435 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 173/368] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:09 2022] GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe => generated 1366 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:10.130700 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-c648bf2d-b5fb-4b32-b9d2-a3abfb2fa12b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:10.144432 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-c648bf2d-b5fb-4b32-b9d2-a3abfb2fa12b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:10.146466 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-c648bf2d-b5fb-4b32-b9d2-a3abfb2fa12b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:10.147590 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-c648bf2d-b5fb-4b32-b9d2-a3abfb2fa12b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1740 microversion: 2.20 time: 0.297279 Jun 30 10:03:10.148252 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 196/369] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:09 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1740 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:03:10.236268 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-c9ad828c-e5b8-4fc9-91ba-31b643c7bec8 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:10.237237 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-c9ad828c-e5b8-4fc9-91ba-31b643c7bec8 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:10.244986 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c9ad828c-e5b8-4fc9-91ba-31b643c7bec8 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:10.245529 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c9ad828c-e5b8-4fc9-91ba-31b643c7bec8 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:10.246373 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c9ad828c-e5b8-4fc9-91ba-31b643c7bec8 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:10.246873 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c9ad828c-e5b8-4fc9-91ba-31b643c7bec8 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:10.397111 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-c9ad828c-e5b8-4fc9-91ba-31b643c7bec8 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:10.405603 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-c9ad828c-e5b8-4fc9-91ba-31b643c7bec8 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1548 microversion: 2.1 time: 0.175480 Jun 30 10:03:10.406177 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 174/370] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:10 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1548 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:10.423560 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-172c31c3-acbf-47a7-bc2d-710551f878f5 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:10.424216 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-172c31c3-acbf-47a7-bc2d-710551f878f5 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:10.431084 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-172c31c3-acbf-47a7-bc2d-710551f878f5 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:10.432185 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-172c31c3-acbf-47a7-bc2d-710551f878f5 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:10.433264 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-172c31c3-acbf-47a7-bc2d-710551f878f5 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:10.433706 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-172c31c3-acbf-47a7-bc2d-710551f878f5 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:10.539849 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-896560b7-f64c-4628-b2bb-9c6001dcc97a tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:10.540611 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-896560b7-f64c-4628-b2bb-9c6001dcc97a tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 8e2cdb14-25e9-4273-9606-a2c458b4ebd2] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:10.547410 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-896560b7-f64c-4628-b2bb-9c6001dcc97a tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:10.548126 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-896560b7-f64c-4628-b2bb-9c6001dcc97a tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:10.549179 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-896560b7-f64c-4628-b2bb-9c6001dcc97a tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:10.549765 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-896560b7-f64c-4628-b2bb-9c6001dcc97a tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:10.621507 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-172c31c3-acbf-47a7-bc2d-710551f878f5 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:10.639591 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-172c31c3-acbf-47a7-bc2d-710551f878f5 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1548 microversion: 2.1 time: 0.211110 Jun 30 10:03:10.640876 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 197/371] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:10 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1548 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:10.655755 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-bcbce28e-bfc9-4444-abf6-5262435cfcf7 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:10.660173 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-bcbce28e-bfc9-4444-abf6-5262435cfcf7 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:10.661342 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-bcbce28e-bfc9-4444-abf6-5262435cfcf7 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Searching by: {'deleted': False, 'project_id': 'd589375d668e413d839c63b0c3d4f104'} {{(pid=117846) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 30 10:03:10.669860 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bcbce28e-bfc9-4444-abf6-5262435cfcf7 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:10.671286 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bcbce28e-bfc9-4444-abf6-5262435cfcf7 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:10.672455 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bcbce28e-bfc9-4444-abf6-5262435cfcf7 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:10.673064 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bcbce28e-bfc9-4444-abf6-5262435cfcf7 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:10.771604 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.multi_cell_list [None req-bcbce28e-bfc9-4444-abf6-5262435cfcf7 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117846) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 30 10:03:10.772738 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-896560b7-f64c-4628-b2bb-9c6001dcc97a tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:10.783660 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-896560b7-f64c-4628-b2bb-9c6001dcc97a tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2" status: 200 len: 1319 microversion: 2.1 time: 0.249531 Jun 30 10:03:10.785167 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 175/372] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:10 2022] GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2 => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:10.790276 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-56d67761-f9c6-4081-b5f5-af081130f803 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:10.791152 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-56d67761-f9c6-4081-b5f5-af081130f803 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:10.798122 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-56d67761-f9c6-4081-b5f5-af081130f803 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:10.798752 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-56d67761-f9c6-4081-b5f5-af081130f803 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:10.799772 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-56d67761-f9c6-4081-b5f5-af081130f803 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:10.800463 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-56d67761-f9c6-4081-b5f5-af081130f803 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:10.873827 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-56d67761-f9c6-4081-b5f5-af081130f803 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:10.881724 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-56d67761-f9c6-4081-b5f5-af081130f803 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1298 microversion: 2.1 time: 0.095292 Jun 30 10:03:10.882581 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 176/373] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:10 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1298 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:10.885907 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-bcbce28e-bfc9-4444-abf6-5262435cfcf7 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.234089 Jun 30 10:03:10.886772 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 198/374] 10.222.0.16 () {58 vars in 1124 bytes} [Thu Jun 30 10:03:10 2022] GET /compute/v2.1/servers => generated 342 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:03:10.905642 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-2e8dbb55-5d97-4d79-9d52-0068d6233831 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:10.906629 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-2e8dbb55-5d97-4d79-9d52-0068d6233831 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:10.914659 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2e8dbb55-5d97-4d79-9d52-0068d6233831 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:10.914659 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2e8dbb55-5d97-4d79-9d52-0068d6233831 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:10.915139 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2e8dbb55-5d97-4d79-9d52-0068d6233831 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:10.915569 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2e8dbb55-5d97-4d79-9d52-0068d6233831 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:11.078128 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-2e8dbb55-5d97-4d79-9d52-0068d6233831 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:11.086286 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-2e8dbb55-5d97-4d79-9d52-0068d6233831 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1548 microversion: 2.1 time: 0.184520 Jun 30 10:03:11.087767 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 177/375] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:10 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1548 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:11.118916 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-66ac5e9f-e6e3-43da-9671-b908b6fcdcc6 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:11.119534 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-66ac5e9f-e6e3-43da-9671-b908b6fcdcc6 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 4223d53f-8e20-4343-9119-08cd7dfa6afe] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:11.126364 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-66ac5e9f-e6e3-43da-9671-b908b6fcdcc6 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:11.126802 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-66ac5e9f-e6e3-43da-9671-b908b6fcdcc6 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:11.127557 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-66ac5e9f-e6e3-43da-9671-b908b6fcdcc6 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:11.128005 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-66ac5e9f-e6e3-43da-9671-b908b6fcdcc6 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:11.166736 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-cb21f12d-e251-4bf4-8526-33d8bf13fb13 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:11.167603 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-cb21f12d-e251-4bf4-8526-33d8bf13fb13 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:11.176542 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-cb21f12d-e251-4bf4-8526-33d8bf13fb13 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:11.178444 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-cb21f12d-e251-4bf4-8526-33d8bf13fb13 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:11.180754 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-cb21f12d-e251-4bf4-8526-33d8bf13fb13 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:11.181393 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-cb21f12d-e251-4bf4-8526-33d8bf13fb13 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:11.378683 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-66ac5e9f-e6e3-43da-9671-b908b6fcdcc6 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:11.395352 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-66ac5e9f-e6e3-43da-9671-b908b6fcdcc6 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe" status: 200 len: 1366 microversion: 2.1 time: 0.280359 Jun 30 10:03:11.396819 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 199/376] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:11 2022] GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:11.425395 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-cb21f12d-e251-4bf4-8526-33d8bf13fb13 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:11.438188 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-cb21f12d-e251-4bf4-8526-33d8bf13fb13 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:11.440191 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-cb21f12d-e251-4bf4-8526-33d8bf13fb13 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:11.441750 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-cb21f12d-e251-4bf4-8526-33d8bf13fb13 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1740 microversion: 2.20 time: 0.279068 Jun 30 10:03:11.442373 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 178/377] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:11 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1740 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:03:11.802053 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-665b3b76-ee10-4a7e-872c-33dff8a3223b tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:11.802869 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-665b3b76-ee10-4a7e-872c-33dff8a3223b tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 8e2cdb14-25e9-4273-9606-a2c458b4ebd2] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:11.809452 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-665b3b76-ee10-4a7e-872c-33dff8a3223b tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:11.809992 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-665b3b76-ee10-4a7e-872c-33dff8a3223b tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:11.810842 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-665b3b76-ee10-4a7e-872c-33dff8a3223b tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:11.811623 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-665b3b76-ee10-4a7e-872c-33dff8a3223b tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:11.899998 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-045bdafc-f8a5-4bec-8ea3-591e1c578a61 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:11.901372 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-045bdafc-f8a5-4bec-8ea3-591e1c578a61 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:11.909607 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-045bdafc-f8a5-4bec-8ea3-591e1c578a61 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:11.910325 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-045bdafc-f8a5-4bec-8ea3-591e1c578a61 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:11.912586 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-045bdafc-f8a5-4bec-8ea3-591e1c578a61 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:11.913413 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-045bdafc-f8a5-4bec-8ea3-591e1c578a61 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:11.966171 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-665b3b76-ee10-4a7e-872c-33dff8a3223b tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:11.975418 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-665b3b76-ee10-4a7e-872c-33dff8a3223b tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2" status: 200 len: 1319 microversion: 2.1 time: 0.177702 Jun 30 10:03:11.987752 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-045bdafc-f8a5-4bec-8ea3-591e1c578a61 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:11.995764 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-045bdafc-f8a5-4bec-8ea3-591e1c578a61 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1298 microversion: 2.1 time: 0.100052 Jun 30 10:03:12.005213 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 179/378] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:11 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1298 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:12.011074 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 200/379] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:11 2022] GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2 => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:12.415150 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-82012709-7047-4355-930d-55b6a1e482ce tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:12.416529 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-82012709-7047-4355-930d-55b6a1e482ce tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 4223d53f-8e20-4343-9119-08cd7dfa6afe] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:12.423364 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-82012709-7047-4355-930d-55b6a1e482ce tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:12.423904 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-82012709-7047-4355-930d-55b6a1e482ce tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:12.424676 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-82012709-7047-4355-930d-55b6a1e482ce tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:12.425268 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-82012709-7047-4355-930d-55b6a1e482ce tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:12.464673 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-b822e526-8a56-42c8-8d93-d6e176b32fa9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:12.466015 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-b822e526-8a56-42c8-8d93-d6e176b32fa9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:12.473681 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b822e526-8a56-42c8-8d93-d6e176b32fa9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:12.474124 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b822e526-8a56-42c8-8d93-d6e176b32fa9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:12.474887 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b822e526-8a56-42c8-8d93-d6e176b32fa9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:12.475307 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b822e526-8a56-42c8-8d93-d6e176b32fa9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:12.691423 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-82012709-7047-4355-930d-55b6a1e482ce tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:12.704698 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-82012709-7047-4355-930d-55b6a1e482ce tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe" status: 200 len: 1366 microversion: 2.1 time: 0.293587 Jun 30 10:03:12.716380 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 180/380] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:12 2022] GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe => generated 1366 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:12.727179 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-b822e526-8a56-42c8-8d93-d6e176b32fa9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:12.737268 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-b822e526-8a56-42c8-8d93-d6e176b32fa9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:12.740546 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-b822e526-8a56-42c8-8d93-d6e176b32fa9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:12.742808 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-b822e526-8a56-42c8-8d93-d6e176b32fa9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1740 microversion: 2.20 time: 0.285902 Jun 30 10:03:12.744528 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 201/381] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:12 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1740 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:03:12.993860 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-06fc79df-0da6-455b-8836-787ffa612e61 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:12.994471 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-06fc79df-0da6-455b-8836-787ffa612e61 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 8e2cdb14-25e9-4273-9606-a2c458b4ebd2] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:13.002822 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-06fc79df-0da6-455b-8836-787ffa612e61 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:13.003265 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-06fc79df-0da6-455b-8836-787ffa612e61 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:13.004076 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-06fc79df-0da6-455b-8836-787ffa612e61 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:13.004506 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-06fc79df-0da6-455b-8836-787ffa612e61 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:13.021541 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-b0b48262-950c-43b8-b1e3-c784aa61734b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:13.022333 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-b0b48262-950c-43b8-b1e3-c784aa61734b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:13.033846 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b0b48262-950c-43b8-b1e3-c784aa61734b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:13.034294 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b0b48262-950c-43b8-b1e3-c784aa61734b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:13.036609 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b0b48262-950c-43b8-b1e3-c784aa61734b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:13.037317 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b0b48262-950c-43b8-b1e3-c784aa61734b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:13.133063 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-b0b48262-950c-43b8-b1e3-c784aa61734b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:13.149737 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-b0b48262-950c-43b8-b1e3-c784aa61734b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1298 microversion: 2.1 time: 0.140902 Jun 30 10:03:13.150461 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 202/382] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:13 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1298 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:03:13.200892 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-06fc79df-0da6-455b-8836-787ffa612e61 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:13.209128 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-06fc79df-0da6-455b-8836-787ffa612e61 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2" status: 200 len: 1319 microversion: 2.1 time: 0.219126 Jun 30 10:03:13.209816 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 181/383] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:12 2022] GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2 => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:13.407499 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-0979831e-cfc9-4f39-b216-a81f26eb4b35 req-ed493ec2-cdfb-43df-8ff8-5155cfc2f5c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e2cdb14-25e9-4273-9606-a2c458b4ebd2", "name": "network-vif-plugged", "status": "completed", "tag": "64a7a6be-2b47-4c6f-9bc2-8e87a6042470"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:03:13.416311 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-0979831e-cfc9-4f39-b216-a81f26eb4b35 req-ed493ec2-cdfb-43df-8ff8-5155cfc2f5c2 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:13.416711 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-0979831e-cfc9-4f39-b216-a81f26eb4b35 req-ed493ec2-cdfb-43df-8ff8-5155cfc2f5c2 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:13.428119 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-0979831e-cfc9-4f39-b216-a81f26eb4b35 req-ed493ec2-cdfb-43df-8ff8-5155cfc2f5c2 service nova] Creating event network-vif-plugged:64a7a6be-2b47-4c6f-9bc2-8e87a6042470 for instance 8e2cdb14-25e9-4273-9606-a2c458b4ebd2 on hv-cinder-84330 Jun 30 10:03:13.434103 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-0979831e-cfc9-4f39-b216-a81f26eb4b35 req-ed493ec2-cdfb-43df-8ff8-5155cfc2f5c2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030313 Jun 30 10:03:13.434908 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 203/384] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:03:13.722402 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-787d5331-8a91-4e7a-99a2-1dcf665614ae tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:13.723001 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-787d5331-8a91-4e7a-99a2-1dcf665614ae tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 4223d53f-8e20-4343-9119-08cd7dfa6afe] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:13.729409 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-787d5331-8a91-4e7a-99a2-1dcf665614ae tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:13.729871 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-787d5331-8a91-4e7a-99a2-1dcf665614ae tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:13.730603 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-787d5331-8a91-4e7a-99a2-1dcf665614ae tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:13.731025 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-787d5331-8a91-4e7a-99a2-1dcf665614ae tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:13.762835 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e7021edb-623b-453b-9463-dda7d34354ce tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:13.763650 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-e7021edb-623b-453b-9463-dda7d34354ce tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:13.770730 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e7021edb-623b-453b-9463-dda7d34354ce tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:13.771518 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e7021edb-623b-453b-9463-dda7d34354ce tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:13.778385 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e7021edb-623b-453b-9463-dda7d34354ce tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:13.779024 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e7021edb-623b-453b-9463-dda7d34354ce tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:13.912838 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-787d5331-8a91-4e7a-99a2-1dcf665614ae tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:13.920897 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-787d5331-8a91-4e7a-99a2-1dcf665614ae tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe" status: 200 len: 1366 microversion: 2.1 time: 0.202101 Jun 30 10:03:13.921771 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 182/385] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:13 2022] GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:13.927703 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-4274bc3e-b4f6-437b-a1e0-a73444ed75bc tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "53965418-3b2f-4d48-9d7f-6dc46d07ce8c"}} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:03:13.928922 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-4274bc3e-b4f6-437b-a1e0-a73444ed75bc tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:13.935821 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4274bc3e-b4f6-437b-a1e0-a73444ed75bc tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:13.936332 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4274bc3e-b4f6-437b-a1e0-a73444ed75bc tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:13.937239 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4274bc3e-b4f6-437b-a1e0-a73444ed75bc tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:13.937665 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4274bc3e-b4f6-437b-a1e0-a73444ed75bc tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:13.960943 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e7021edb-623b-453b-9463-dda7d34354ce tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:13.969904 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e7021edb-623b-453b-9463-dda7d34354ce tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:13.971694 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e7021edb-623b-453b-9463-dda7d34354ce tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:13.972986 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-e7021edb-623b-453b-9463-dda7d34354ce tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1740 microversion: 2.20 time: 0.214709 Jun 30 10:03:13.973631 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 204/386] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:13 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1740 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:03:14.166585 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-fec2691d-108e-4b6d-a581-1aeb20d906c7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:14.167626 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-fec2691d-108e-4b6d-a581-1aeb20d906c7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:14.175128 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fec2691d-108e-4b6d-a581-1aeb20d906c7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:14.175752 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fec2691d-108e-4b6d-a581-1aeb20d906c7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:14.176754 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fec2691d-108e-4b6d-a581-1aeb20d906c7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:14.177452 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fec2691d-108e-4b6d-a581-1aeb20d906c7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:14.243548 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-fec2691d-108e-4b6d-a581-1aeb20d906c7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:14.251517 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-fec2691d-108e-4b6d-a581-1aeb20d906c7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1306 microversion: 2.1 time: 0.088893 Jun 30 10:03:14.252476 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 205/387] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:14 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1306 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:03:14.257943 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-7fb07bbe-0603-42ca-bd54-7e6aa34c926e tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:14.258547 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-7fb07bbe-0603-42ca-bd54-7e6aa34c926e tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 8e2cdb14-25e9-4273-9606-a2c458b4ebd2] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:14.264805 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7fb07bbe-0603-42ca-bd54-7e6aa34c926e tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:14.265250 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7fb07bbe-0603-42ca-bd54-7e6aa34c926e tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:14.266124 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7fb07bbe-0603-42ca-bd54-7e6aa34c926e tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:14.266632 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7fb07bbe-0603-42ca-bd54-7e6aa34c926e tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:14.419225 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7fb07bbe-0603-42ca-bd54-7e6aa34c926e tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:14.427748 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-7fb07bbe-0603-42ca-bd54-7e6aa34c926e tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2" status: 200 len: 1319 microversion: 2.1 time: 0.173900 Jun 30 10:03:14.428387 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 206/388] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:14 2022] GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:14.792571 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-4274bc3e-b4f6-437b-a1e0-a73444ed75bc tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "POST /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.868962 Jun 30 10:03:14.793278 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 183/389] 10.222.0.16 () {60 vars in 1322 bytes} [Thu Jun 30 10:03:13 2022] POST /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be/os-volume_attachments => generated 194 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:03:14.937798 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-31f50fba-4829-44da-a37a-15e1053733f9 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:14.938393 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-31f50fba-4829-44da-a37a-15e1053733f9 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 4223d53f-8e20-4343-9119-08cd7dfa6afe] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:14.940539 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:03:14.946472 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-31f50fba-4829-44da-a37a-15e1053733f9 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:14.946926 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-31f50fba-4829-44da-a37a-15e1053733f9 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:14.947697 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-31f50fba-4829-44da-a37a-15e1053733f9 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:14.948156 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-31f50fba-4829-44da-a37a-15e1053733f9 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:14.953545 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=100 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:03:14.992745 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-1a255ace-b86c-48d7-8099-5e5ee3fd48e2 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:14.993443 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-1a255ace-b86c-48d7-8099-5e5ee3fd48e2 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:15.000282 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1a255ace-b86c-48d7-8099-5e5ee3fd48e2 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:15.000728 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1a255ace-b86c-48d7-8099-5e5ee3fd48e2 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:15.001501 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1a255ace-b86c-48d7-8099-5e5ee3fd48e2 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:15.001940 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1a255ace-b86c-48d7-8099-5e5ee3fd48e2 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:15.464291 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-1a255ace-b86c-48d7-8099-5e5ee3fd48e2 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:15.476642 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-1a255ace-b86c-48d7-8099-5e5ee3fd48e2 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:15.482842 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-1a255ace-b86c-48d7-8099-5e5ee3fd48e2 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:15.489093 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-1a255ace-b86c-48d7-8099-5e5ee3fd48e2 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1722 microversion: 2.20 time: 0.496408 Jun 30 10:03:15.490141 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 184/390] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:14 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1722 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:03:15.495407 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-31f50fba-4829-44da-a37a-15e1053733f9 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:15.507785 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-9c914f23-2b24-4781-b2bc-845de0a516ba tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:15.508652 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-9c914f23-2b24-4781-b2bc-845de0a516ba tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:15.510458 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-31f50fba-4829-44da-a37a-15e1053733f9 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe" status: 200 len: 1366 microversion: 2.1 time: 0.576537 Jun 30 10:03:15.512051 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 207/391] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:14 2022] GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe => generated 1366 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:15.523905 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-8ff02f3a-134c-4140-ac10-a41b4dfd0517 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:15.528097 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-8ff02f3a-134c-4140-ac10-a41b4dfd0517 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 8e2cdb14-25e9-4273-9606-a2c458b4ebd2] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:15.533290 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9c914f23-2b24-4781-b2bc-845de0a516ba tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:15.534219 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9c914f23-2b24-4781-b2bc-845de0a516ba tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:15.535212 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9c914f23-2b24-4781-b2bc-845de0a516ba tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:15.535641 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9c914f23-2b24-4781-b2bc-845de0a516ba tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:15.547244 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8ff02f3a-134c-4140-ac10-a41b4dfd0517 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:15.548409 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8ff02f3a-134c-4140-ac10-a41b4dfd0517 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:15.549403 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8ff02f3a-134c-4140-ac10-a41b4dfd0517 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:15.550053 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8ff02f3a-134c-4140-ac10-a41b4dfd0517 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:15.641290 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-9c914f23-2b24-4781-b2bc-845de0a516ba tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:15.654560 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-9c914f23-2b24-4781-b2bc-845de0a516ba tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1304 microversion: 2.1 time: 0.150647 Jun 30 10:03:15.656120 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 185/392] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:15 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1304 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:16.014703 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-8ff02f3a-134c-4140-ac10-a41b4dfd0517 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:16.023034 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-8ff02f3a-134c-4140-ac10-a41b4dfd0517 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2" status: 200 len: 1319 microversion: 2.1 time: 0.508862 Jun 30 10:03:16.031963 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 208/393] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:15 2022] GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2 => generated 1319 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:16.509184 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-ce7b452d-7213-4f2f-b972-183d2bff8efc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:16.510140 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-ce7b452d-7213-4f2f-b972-183d2bff8efc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:16.517172 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ce7b452d-7213-4f2f-b972-183d2bff8efc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:16.517614 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ce7b452d-7213-4f2f-b972-183d2bff8efc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:16.518414 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ce7b452d-7213-4f2f-b972-183d2bff8efc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:16.518850 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ce7b452d-7213-4f2f-b972-183d2bff8efc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:16.528444 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-9602033b-425c-4613-a87c-1d5a6537690e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:16.529323 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-9602033b-425c-4613-a87c-1d5a6537690e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 4223d53f-8e20-4343-9119-08cd7dfa6afe] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:16.537102 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9602033b-425c-4613-a87c-1d5a6537690e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:16.537561 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9602033b-425c-4613-a87c-1d5a6537690e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:16.538336 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9602033b-425c-4613-a87c-1d5a6537690e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:16.538940 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9602033b-425c-4613-a87c-1d5a6537690e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:17.022624 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-ce7b452d-7213-4f2f-b972-183d2bff8efc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:17.031500 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-ce7b452d-7213-4f2f-b972-183d2bff8efc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:17.033031 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-ce7b452d-7213-4f2f-b972-183d2bff8efc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:17.034330 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-ce7b452d-7213-4f2f-b972-183d2bff8efc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1722 microversion: 2.20 time: 0.529609 Jun 30 10:03:17.034888 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 186/394] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:16 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1722 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:03:17.040343 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-dd182c73-80ea-4885-8a5a-c02888b1e845 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:17.041475 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-dd182c73-80ea-4885-8a5a-c02888b1e845 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:17.044584 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:03:17.049321 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-dd182c73-80ea-4885-8a5a-c02888b1e845 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:17.049767 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-dd182c73-80ea-4885-8a5a-c02888b1e845 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:17.050550 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-dd182c73-80ea-4885-8a5a-c02888b1e845 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:17.051150 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-dd182c73-80ea-4885-8a5a-c02888b1e845 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:17.063986 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-9602033b-425c-4613-a87c-1d5a6537690e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:17.072262 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-9602033b-425c-4613-a87c-1d5a6537690e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe" status: 200 len: 1366 microversion: 2.1 time: 0.547706 Jun 30 10:03:17.081583 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 209/395] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:16 2022] GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe => generated 1366 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:03:17.086620 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-31ef8c5f-d925-4123-871f-0a37a8e0a53e tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:17.087229 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-31ef8c5f-d925-4123-871f-0a37a8e0a53e tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 8e2cdb14-25e9-4273-9606-a2c458b4ebd2] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:17.093368 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-31ef8c5f-d925-4123-871f-0a37a8e0a53e tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:17.093814 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-31ef8c5f-d925-4123-871f-0a37a8e0a53e tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:17.094573 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-31ef8c5f-d925-4123-871f-0a37a8e0a53e tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:17.095001 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-31ef8c5f-d925-4123-871f-0a37a8e0a53e tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:17.553113 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-31ef8c5f-d925-4123-871f-0a37a8e0a53e tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:17.558078 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-dd182c73-80ea-4885-8a5a-c02888b1e845 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:17.561606 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-31ef8c5f-d925-4123-871f-0a37a8e0a53e tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2" status: 200 len: 1508 microversion: 2.1 time: 0.478895 Jun 30 10:03:17.567136 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-dd182c73-80ea-4885-8a5a-c02888b1e845 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1372 microversion: 2.1 time: 0.530878 Jun 30 10:03:17.568655 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 187/396] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:17 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1372 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:17.577558 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 210/397] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:17 2022] GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2 => generated 1508 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:17.589524 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-3de611b1-54d0-4a27-9827-af8e3a8dff79 req-04248aae-33ea-4c34-88d5-28a9b98ef1cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4223d53f-8e20-4343-9119-08cd7dfa6afe", "name": "network-vif-plugged", "status": "completed", "tag": "709dddb2-4ee5-4391-9682-278c94b807de"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:03:17.598157 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-3de611b1-54d0-4a27-9827-af8e3a8dff79 req-04248aae-33ea-4c34-88d5-28a9b98ef1cc service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:17.598946 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-3de611b1-54d0-4a27-9827-af8e3a8dff79 req-04248aae-33ea-4c34-88d5-28a9b98ef1cc service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:17.614743 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-3de611b1-54d0-4a27-9827-af8e3a8dff79 req-04248aae-33ea-4c34-88d5-28a9b98ef1cc service nova] Creating event network-vif-plugged:709dddb2-4ee5-4391-9682-278c94b807de for instance 4223d53f-8e20-4343-9119-08cd7dfa6afe on hv-cinder-84330 Jun 30 10:03:17.620171 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-3de611b1-54d0-4a27-9827-af8e3a8dff79 req-04248aae-33ea-4c34-88d5-28a9b98ef1cc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044012 Jun 30 10:03:17.621279 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 211/398] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:03:17.960480 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [req-455162c8-1c6d-496c-98eb-6b150f9eeca4 req-c7f6d74b-18e8-40f2-bec5-fdfc8ac90e90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "114a9363-7f11-4906-959f-37a7d3275e52", "tag": "290c2729-5bcd-422d-afde-63f591011bcf"}]} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:03:17.991490 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-455162c8-1c6d-496c-98eb-6b150f9eeca4 req-c7f6d74b-18e8-40f2-bec5-fdfc8ac90e90 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:17.992182 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-455162c8-1c6d-496c-98eb-6b150f9eeca4 req-c7f6d74b-18e8-40f2-bec5-fdfc8ac90e90 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:18.015650 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.compute.server_external_events [req-455162c8-1c6d-496c-98eb-6b150f9eeca4 req-c7f6d74b-18e8-40f2-bec5-fdfc8ac90e90 service nova] Creating event network-changed:290c2729-5bcd-422d-afde-63f591011bcf for instance 114a9363-7f11-4906-959f-37a7d3275e52 on hv-cinder-84330 Jun 30 10:03:18.021390 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [req-455162c8-1c6d-496c-98eb-6b150f9eeca4 req-c7f6d74b-18e8-40f2-bec5-fdfc8ac90e90 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068911 Jun 30 10:03:18.024033 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 188/399] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:03:18.054340 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-55638849-f008-4f05-9ee5-89377621696e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:18.055099 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-55638849-f008-4f05-9ee5-89377621696e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:18.073946 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-55638849-f008-4f05-9ee5-89377621696e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:18.074547 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-55638849-f008-4f05-9ee5-89377621696e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:18.075288 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-55638849-f008-4f05-9ee5-89377621696e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:18.075950 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-55638849-f008-4f05-9ee5-89377621696e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:18.092698 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-d17daa6b-1174-49c3-8f83-a5dcd3fea746 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:18.093505 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-d17daa6b-1174-49c3-8f83-a5dcd3fea746 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 4223d53f-8e20-4343-9119-08cd7dfa6afe] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:18.105366 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d17daa6b-1174-49c3-8f83-a5dcd3fea746 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:18.105917 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d17daa6b-1174-49c3-8f83-a5dcd3fea746 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:18.108142 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d17daa6b-1174-49c3-8f83-a5dcd3fea746 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:18.109954 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d17daa6b-1174-49c3-8f83-a5dcd3fea746 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:18.171039 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:03:18.273093 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell0:SELECT=4 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:03:18.302654 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell0:SELECT=14 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:03:18.359351 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-55638849-f008-4f05-9ee5-89377621696e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:18.369836 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-55638849-f008-4f05-9ee5-89377621696e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:18.372350 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-55638849-f008-4f05-9ee5-89377621696e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:18.374283 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-55638849-f008-4f05-9ee5-89377621696e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1722 microversion: 2.20 time: 0.324414 Jun 30 10:03:18.375599 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 212/400] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:18 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1722 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:03:18.384935 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-d17daa6b-1174-49c3-8f83-a5dcd3fea746 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:18.394441 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-d17daa6b-1174-49c3-8f83-a5dcd3fea746 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe" status: 200 len: 1366 microversion: 2.1 time: 0.309102 Jun 30 10:03:18.395570 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 189/401] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:18 2022] GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe => generated 1366 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:03:18.585840 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-df7243ba-727e-4aa5-a31b-3234be58a17e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:18.586449 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-df7243ba-727e-4aa5-a31b-3234be58a17e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:18.588509 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=6 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:03:18.595794 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-df7243ba-727e-4aa5-a31b-3234be58a17e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:18.596349 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-df7243ba-727e-4aa5-a31b-3234be58a17e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:18.597242 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-df7243ba-727e-4aa5-a31b-3234be58a17e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:18.597722 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-df7243ba-727e-4aa5-a31b-3234be58a17e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:18.745713 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-df7243ba-727e-4aa5-a31b-3234be58a17e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:18.758380 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-df7243ba-727e-4aa5-a31b-3234be58a17e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1372 microversion: 2.1 time: 0.176444 Jun 30 10:03:18.759259 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 213/402] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:18 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1372 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:19.393428 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-ac3c37f0-db47-403c-b249-033f93451d33 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:19.393982 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-ac3c37f0-db47-403c-b249-033f93451d33 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:19.400847 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ac3c37f0-db47-403c-b249-033f93451d33 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:19.401519 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ac3c37f0-db47-403c-b249-033f93451d33 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:19.402277 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ac3c37f0-db47-403c-b249-033f93451d33 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:19.402695 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ac3c37f0-db47-403c-b249-033f93451d33 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:19.413345 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e266038b-71eb-40eb-a17a-21469a0c5a29 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:19.414851 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-e266038b-71eb-40eb-a17a-21469a0c5a29 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 4223d53f-8e20-4343-9119-08cd7dfa6afe] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:19.423649 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e266038b-71eb-40eb-a17a-21469a0c5a29 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:19.424669 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e266038b-71eb-40eb-a17a-21469a0c5a29 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:19.425787 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e266038b-71eb-40eb-a17a-21469a0c5a29 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:19.426486 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e266038b-71eb-40eb-a17a-21469a0c5a29 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:20.029144 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e266038b-71eb-40eb-a17a-21469a0c5a29 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:20.041716 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-e266038b-71eb-40eb-a17a-21469a0c5a29 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe" status: 200 len: 1366 microversion: 2.1 time: 0.632326 Jun 30 10:03:20.042279 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-ac3c37f0-db47-403c-b249-033f93451d33 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:20.044741 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 214/403] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:19 2022] GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe => generated 1366 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:03:20.056487 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-0a0fcfd1-a177-4245-afe5-9d4da0472ad3 req-ada50242-13d6-45fe-ae86-d44ba05040ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c15c69f-e851-41aa-9f31-0e897b2f302d", "name": "network-vif-unplugged", "status": "completed", "tag": "c1be8ae5-cf30-4b83-be1b-6a94517a895b"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:03:20.057119 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-ac3c37f0-db47-403c-b249-033f93451d33 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:20.059110 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-ac3c37f0-db47-403c-b249-033f93451d33 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:20.060765 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-ac3c37f0-db47-403c-b249-033f93451d33 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1722 microversion: 2.20 time: 0.671272 Jun 30 10:03:20.061880 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 190/404] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:19 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1722 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:03:20.067554 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-efd4ab14-adc9-43c4-8764-99a86c2c01cb tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:20.068070 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-0a0fcfd1-a177-4245-afe5-9d4da0472ad3 req-ada50242-13d6-45fe-ae86-d44ba05040ca service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:20.068466 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-efd4ab14-adc9-43c4-8764-99a86c2c01cb tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:20.069070 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-0a0fcfd1-a177-4245-afe5-9d4da0472ad3 req-ada50242-13d6-45fe-ae86-d44ba05040ca service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:20.076732 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-efd4ab14-adc9-43c4-8764-99a86c2c01cb tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:20.077480 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-efd4ab14-adc9-43c4-8764-99a86c2c01cb tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:20.078664 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-efd4ab14-adc9-43c4-8764-99a86c2c01cb tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:20.080151 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-efd4ab14-adc9-43c4-8764-99a86c2c01cb tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:20.087256 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.compute.server_external_events [req-0a0fcfd1-a177-4245-afe5-9d4da0472ad3 req-ada50242-13d6-45fe-ae86-d44ba05040ca service nova] Unable to find a host for instance 8c15c69f-e851-41aa-9f31-0e897b2f302d. Dropping event network-vif-unplugged {{(pid=117846) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 30 10:03:20.088323 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-0a0fcfd1-a177-4245-afe5-9d4da0472ad3 req-ada50242-13d6-45fe-ae86-d44ba05040ca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.041716 Jun 30 10:03:20.092138 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 215/405] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 47 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 30 10:03:20.216802 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-efd4ab14-adc9-43c4-8764-99a86c2c01cb tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:20.224568 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-efd4ab14-adc9-43c4-8764-99a86c2c01cb tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1372 microversion: 2.1 time: 0.161196 Jun 30 10:03:20.225143 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 191/406] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:20 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:21.062034 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-3250a825-ff7e-425c-908f-9e63e8911bff tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:21.062723 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-3250a825-ff7e-425c-908f-9e63e8911bff tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 4223d53f-8e20-4343-9119-08cd7dfa6afe] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:21.064872 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=2 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:03:21.070969 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3250a825-ff7e-425c-908f-9e63e8911bff tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:21.071399 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3250a825-ff7e-425c-908f-9e63e8911bff tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:21.072165 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3250a825-ff7e-425c-908f-9e63e8911bff tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:21.072593 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3250a825-ff7e-425c-908f-9e63e8911bff tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:21.084295 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-78c91e47-9a39-4033-b145-3ff95cec735d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:21.084846 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-78c91e47-9a39-4033-b145-3ff95cec735d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:21.091721 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-78c91e47-9a39-4033-b145-3ff95cec735d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:21.092206 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-78c91e47-9a39-4033-b145-3ff95cec735d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:21.093189 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-78c91e47-9a39-4033-b145-3ff95cec735d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:21.093612 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-78c91e47-9a39-4033-b145-3ff95cec735d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:21.345873 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-3250a825-ff7e-425c-908f-9e63e8911bff tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:21.355070 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-3250a825-ff7e-425c-908f-9e63e8911bff tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe" status: 200 len: 1366 microversion: 2.1 time: 0.296849 Jun 30 10:03:21.356197 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 216/407] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:21 2022] GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe => generated 1366 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:21.361734 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-57a4cead-df91-4690-be75-b617300d57e7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:21.362543 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-78c91e47-9a39-4033-b145-3ff95cec735d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:21.362699 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-57a4cead-df91-4690-be75-b617300d57e7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:21.370028 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-57a4cead-df91-4690-be75-b617300d57e7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:21.370699 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-57a4cead-df91-4690-be75-b617300d57e7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:21.371478 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-57a4cead-df91-4690-be75-b617300d57e7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:21.371936 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-57a4cead-df91-4690-be75-b617300d57e7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:21.372833 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-78c91e47-9a39-4033-b145-3ff95cec735d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:21.374531 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-78c91e47-9a39-4033-b145-3ff95cec735d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:21.375729 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-78c91e47-9a39-4033-b145-3ff95cec735d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1665 microversion: 2.20 time: 0.295387 Jun 30 10:03:21.377723 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 192/408] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:21 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1665 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:03:21.395354 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-193ba05e-580f-4707-b82d-9d17c5849a47 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "69b676e6-2807-4a21-a60a-9c0ebb23b487"}} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:03:21.396919 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-193ba05e-580f-4707-b82d-9d17c5849a47 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:21.403455 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-193ba05e-580f-4707-b82d-9d17c5849a47 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:21.403951 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-193ba05e-580f-4707-b82d-9d17c5849a47 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:21.404701 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-193ba05e-580f-4707-b82d-9d17c5849a47 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:21.405118 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-193ba05e-580f-4707-b82d-9d17c5849a47 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:21.516958 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-57a4cead-df91-4690-be75-b617300d57e7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:21.525083 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-57a4cead-df91-4690-be75-b617300d57e7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1372 microversion: 2.1 time: 0.167672 Jun 30 10:03:21.525835 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 217/409] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:21 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:21.710560 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-193ba05e-580f-4707-b82d-9d17c5849a47 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "POST /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.319189 Jun 30 10:03:21.711139 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 193/410] 10.222.0.16 () {62 vars in 1363 bytes} [Thu Jun 30 10:03:21 2022] POST /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d/os-volume_attachments => generated 188 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 10:03:21.840888 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-250d232d-6cdd-4b08-90d4-e89e27e68952 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:03:21.841618 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-250d232d-6cdd-4b08-90d4-e89e27e68952 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:21.847951 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-250d232d-6cdd-4b08-90d4-e89e27e68952 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:21.848510 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-250d232d-6cdd-4b08-90d4-e89e27e68952 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:21.849454 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-250d232d-6cdd-4b08-90d4-e89e27e68952 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:21.850033 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-250d232d-6cdd-4b08-90d4-e89e27e68952 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:21.948812 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-250d232d-6cdd-4b08-90d4-e89e27e68952 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "POST /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d/action" status: 202 len: 0 microversion: 2.20 time: 0.111823 Jun 30 10:03:21.949627 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 218/411] 10.222.0.16 () {62 vars in 1318 bytes} [Thu Jun 30 10:03:21 2022] POST /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 30 10:03:21.957844 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-3fc40158-6223-4ba6-af21-209a07e0890d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:21.958621 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-3fc40158-6223-4ba6-af21-209a07e0890d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:21.965715 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3fc40158-6223-4ba6-af21-209a07e0890d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:21.966227 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3fc40158-6223-4ba6-af21-209a07e0890d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:21.967042 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3fc40158-6223-4ba6-af21-209a07e0890d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:21.967472 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3fc40158-6223-4ba6-af21-209a07e0890d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:22.112173 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-3fc40158-6223-4ba6-af21-209a07e0890d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:22.121222 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-3fc40158-6223-4ba6-af21-209a07e0890d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:22.122703 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-3fc40158-6223-4ba6-af21-209a07e0890d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:22.123846 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-3fc40158-6223-4ba6-af21-209a07e0890d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1751 microversion: 2.20 time: 0.170154 Jun 30 10:03:22.124424 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 194/412] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:21 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:03:22.372320 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f7c7fc58-72da-44f6-885a-86eb4cd658b6 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:22.373518 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f7c7fc58-72da-44f6-885a-86eb4cd658b6 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 4223d53f-8e20-4343-9119-08cd7dfa6afe] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:22.381898 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f7c7fc58-72da-44f6-885a-86eb4cd658b6 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:22.382462 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f7c7fc58-72da-44f6-885a-86eb4cd658b6 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:22.383502 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f7c7fc58-72da-44f6-885a-86eb4cd658b6 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:22.383954 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f7c7fc58-72da-44f6-885a-86eb4cd658b6 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:22.517453 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f7c7fc58-72da-44f6-885a-86eb4cd658b6 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:22.525608 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f7c7fc58-72da-44f6-885a-86eb4cd658b6 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe" status: 200 len: 1556 microversion: 2.1 time: 0.157761 Jun 30 10:03:22.526163 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 219/413] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:22 2022] GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe => generated 1556 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:22.541997 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-40cc148c-59ff-47c6-bae2-38ab76b3e215 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:22.542203 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-73917e70-6a07-4360-bd80-5ccb9b8984bc tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:22.542524 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-73917e70-6a07-4360-bd80-5ccb9b8984bc tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 4223d53f-8e20-4343-9119-08cd7dfa6afe] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:22.542663 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-40cc148c-59ff-47c6-bae2-38ab76b3e215 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:22.548745 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-73917e70-6a07-4360-bd80-5ccb9b8984bc tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:22.548965 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-40cc148c-59ff-47c6-bae2-38ab76b3e215 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:22.549191 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-73917e70-6a07-4360-bd80-5ccb9b8984bc tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:22.549403 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-40cc148c-59ff-47c6-bae2-38ab76b3e215 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:22.549945 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-73917e70-6a07-4360-bd80-5ccb9b8984bc tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:22.550148 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-40cc148c-59ff-47c6-bae2-38ab76b3e215 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:22.550375 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-73917e70-6a07-4360-bd80-5ccb9b8984bc tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:22.550635 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-40cc148c-59ff-47c6-bae2-38ab76b3e215 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:22.662833 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-73917e70-6a07-4360-bd80-5ccb9b8984bc tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.124344 Jun 30 10:03:22.668258 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 195/414] 10.222.0.16 () {58 vars in 1274 bytes} [Thu Jun 30 10:03:22 2022] GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe/os-interface => generated 284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:03:22.723141 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-40cc148c-59ff-47c6-bae2-38ab76b3e215 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:22.730761 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-40cc148c-59ff-47c6-bae2-38ab76b3e215 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1372 microversion: 2.1 time: 0.192430 Jun 30 10:03:22.731324 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 220/415] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:22 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1372 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:23.143904 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-c80293f9-20af-437c-acdb-0fa2fc051a5a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:23.144623 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-c80293f9-20af-437c-acdb-0fa2fc051a5a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:23.152256 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c80293f9-20af-437c-acdb-0fa2fc051a5a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:23.152717 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c80293f9-20af-437c-acdb-0fa2fc051a5a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:23.153490 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c80293f9-20af-437c-acdb-0fa2fc051a5a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:23.153923 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c80293f9-20af-437c-acdb-0fa2fc051a5a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:23.305899 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-c80293f9-20af-437c-acdb-0fa2fc051a5a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:23.322386 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-c80293f9-20af-437c-acdb-0fa2fc051a5a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:23.325185 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-c80293f9-20af-437c-acdb-0fa2fc051a5a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:23.325717 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-c80293f9-20af-437c-acdb-0fa2fc051a5a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1751 microversion: 2.20 time: 0.186664 Jun 30 10:03:23.336883 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 196/416] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:23 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1751 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:03:23.657435 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-25305663-a41f-4483-a82f-77feb8f0f058 req-38fbadea-0e7c-40ad-82ce-59c7b1e05bfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4223d53f-8e20-4343-9119-08cd7dfa6afe", "tag": "709dddb2-4ee5-4391-9682-278c94b807de"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:03:23.666393 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-25305663-a41f-4483-a82f-77feb8f0f058 req-38fbadea-0e7c-40ad-82ce-59c7b1e05bfe service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:23.666909 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-25305663-a41f-4483-a82f-77feb8f0f058 req-38fbadea-0e7c-40ad-82ce-59c7b1e05bfe service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:23.679741 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-25305663-a41f-4483-a82f-77feb8f0f058 req-38fbadea-0e7c-40ad-82ce-59c7b1e05bfe service nova] Creating event network-changed:709dddb2-4ee5-4391-9682-278c94b807de for instance 4223d53f-8e20-4343-9119-08cd7dfa6afe on hv-cinder-84330 Jun 30 10:03:23.686492 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-25305663-a41f-4483-a82f-77feb8f0f058 req-38fbadea-0e7c-40ad-82ce-59c7b1e05bfe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032852 Jun 30 10:03:23.687620 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 221/417] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:03:23.746940 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-44e31816-c9d2-458e-86d2-006293ac2581 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:23.747655 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-44e31816-c9d2-458e-86d2-006293ac2581 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:23.754240 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-44e31816-c9d2-458e-86d2-006293ac2581 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:23.754681 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-44e31816-c9d2-458e-86d2-006293ac2581 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:23.755760 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-44e31816-c9d2-458e-86d2-006293ac2581 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:23.756213 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-44e31816-c9d2-458e-86d2-006293ac2581 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:23.888081 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-44e31816-c9d2-458e-86d2-006293ac2581 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:23.898164 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-44e31816-c9d2-458e-86d2-006293ac2581 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1372 microversion: 2.1 time: 0.155248 Jun 30 10:03:23.898850 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 197/418] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:23 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:24.346320 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-d59fa369-173e-4133-a827-066a5afbb3b4 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:24.347110 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-d59fa369-173e-4133-a827-066a5afbb3b4 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:24.354471 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d59fa369-173e-4133-a827-066a5afbb3b4 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:24.355090 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d59fa369-173e-4133-a827-066a5afbb3b4 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:24.355901 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d59fa369-173e-4133-a827-066a5afbb3b4 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:24.356866 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d59fa369-173e-4133-a827-066a5afbb3b4 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:24.607292 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-d59fa369-173e-4133-a827-066a5afbb3b4 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:24.608142 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-24d1c8ce-b0c3-4132-a10f-528c3a44c747 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:24.609296 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-24d1c8ce-b0c3-4132-a10f-528c3a44c747 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:24.619430 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-d59fa369-173e-4133-a827-066a5afbb3b4 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:24.621220 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-24d1c8ce-b0c3-4132-a10f-528c3a44c747 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:24.621671 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-24d1c8ce-b0c3-4132-a10f-528c3a44c747 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:24.621922 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-d59fa369-173e-4133-a827-066a5afbb3b4 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:24.622833 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-24d1c8ce-b0c3-4132-a10f-528c3a44c747 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:24.622922 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-24d1c8ce-b0c3-4132-a10f-528c3a44c747 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:24.624907 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-d59fa369-173e-4133-a827-066a5afbb3b4 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1751 microversion: 2.20 time: 0.283154 Jun 30 10:03:24.626188 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 222/419] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:24 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1751 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:03:24.904604 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-24d1c8ce-b0c3-4132-a10f-528c3a44c747 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:24.915195 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-24d1c8ce-b0c3-4132-a10f-528c3a44c747 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1594 microversion: 2.1 time: 0.310833 Jun 30 10:03:24.916597 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 198/420] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:24 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1594 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:24.921572 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-0f0baea2-8f6f-48a7-9aee-b4fa805ede68 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:24.922330 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-0f0baea2-8f6f-48a7-9aee-b4fa805ede68 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:24.930463 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0f0baea2-8f6f-48a7-9aee-b4fa805ede68 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:24.931240 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0f0baea2-8f6f-48a7-9aee-b4fa805ede68 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:24.932632 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0f0baea2-8f6f-48a7-9aee-b4fa805ede68 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:24.933348 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0f0baea2-8f6f-48a7-9aee-b4fa805ede68 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:25.106097 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-0f0baea2-8f6f-48a7-9aee-b4fa805ede68 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:25.114345 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-0f0baea2-8f6f-48a7-9aee-b4fa805ede68 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1372 microversion: 2.1 time: 0.203330 Jun 30 10:03:25.125508 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 223/421] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:24 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1372 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:25.646090 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-d784b19e-c981-4065-895f-e51e25628ae7 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:25.646090 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-d784b19e-c981-4065-895f-e51e25628ae7 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:25.655571 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d784b19e-c981-4065-895f-e51e25628ae7 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:25.656063 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d784b19e-c981-4065-895f-e51e25628ae7 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:25.657044 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d784b19e-c981-4065-895f-e51e25628ae7 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:25.657479 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d784b19e-c981-4065-895f-e51e25628ae7 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:25.805079 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-d784b19e-c981-4065-895f-e51e25628ae7 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:25.814199 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-d784b19e-c981-4065-895f-e51e25628ae7 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:25.815912 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-d784b19e-c981-4065-895f-e51e25628ae7 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:25.817686 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-d784b19e-c981-4065-895f-e51e25628ae7 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1751 microversion: 2.20 time: 0.177146 Jun 30 10:03:25.819909 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 199/422] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:25 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1751 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:03:26.132879 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-9e67ee59-3c62-4470-827f-62b68d50accd tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:26.133448 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-9e67ee59-3c62-4470-827f-62b68d50accd tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:26.140038 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9e67ee59-3c62-4470-827f-62b68d50accd tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:26.140492 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9e67ee59-3c62-4470-827f-62b68d50accd tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:26.141290 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9e67ee59-3c62-4470-827f-62b68d50accd tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:26.141691 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9e67ee59-3c62-4470-827f-62b68d50accd tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:26.280283 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-9e67ee59-3c62-4470-827f-62b68d50accd tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:26.287134 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:03:26.297261 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-9e67ee59-3c62-4470-827f-62b68d50accd tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1372 microversion: 2.1 time: 0.168428 Jun 30 10:03:26.298062 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 224/423] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:26 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1372 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:26.837883 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-0b86643b-b6c4-45c4-9c55-d975d2e8c974 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:26.838515 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-0b86643b-b6c4-45c4-9c55-d975d2e8c974 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:26.846299 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-0b86643b-b6c4-45c4-9c55-d975d2e8c974 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:26.846799 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-0b86643b-b6c4-45c4-9c55-d975d2e8c974 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:26.848015 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-0b86643b-b6c4-45c4-9c55-d975d2e8c974 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:26.848826 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-0b86643b-b6c4-45c4-9c55-d975d2e8c974 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:26.995651 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-0b86643b-b6c4-45c4-9c55-d975d2e8c974 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:27.014693 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-0b86643b-b6c4-45c4-9c55-d975d2e8c974 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:27.016218 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-0b86643b-b6c4-45c4-9c55-d975d2e8c974 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:27.017379 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-0b86643b-b6c4-45c4-9c55-d975d2e8c974 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1751 microversion: 2.20 time: 0.184337 Jun 30 10:03:27.017936 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 200/424] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:26 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1751 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:03:27.066779 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-1e4f2540-667b-4e55-815f-b25051baaf1b req-ab1b05ee-17b2-4ccb-8b2b-681b4d59f963 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2766477-90ca-46bc-b411-a2d1b06b01be", "tag": "5b398ce3-4e1d-45ae-9288-26bcecde73b3"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:03:27.077625 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-1e4f2540-667b-4e55-815f-b25051baaf1b req-ab1b05ee-17b2-4ccb-8b2b-681b4d59f963 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:27.078105 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-1e4f2540-667b-4e55-815f-b25051baaf1b req-ab1b05ee-17b2-4ccb-8b2b-681b4d59f963 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:27.093066 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-1e4f2540-667b-4e55-815f-b25051baaf1b req-ab1b05ee-17b2-4ccb-8b2b-681b4d59f963 service nova] Creating event network-changed:5b398ce3-4e1d-45ae-9288-26bcecde73b3 for instance e2766477-90ca-46bc-b411-a2d1b06b01be on hv-cinder-84330 Jun 30 10:03:27.098294 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-1e4f2540-667b-4e55-815f-b25051baaf1b req-ab1b05ee-17b2-4ccb-8b2b-681b4d59f963 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035139 Jun 30 10:03:27.099796 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 225/425] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:03:27.314621 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-c1ddc534-0e1e-425d-8aa7-5e31f3063c77 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:27.315262 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-c1ddc534-0e1e-425d-8aa7-5e31f3063c77 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:27.326428 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c1ddc534-0e1e-425d-8aa7-5e31f3063c77 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:27.327169 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c1ddc534-0e1e-425d-8aa7-5e31f3063c77 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:27.329551 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c1ddc534-0e1e-425d-8aa7-5e31f3063c77 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:27.334291 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c1ddc534-0e1e-425d-8aa7-5e31f3063c77 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:27.609885 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-c1ddc534-0e1e-425d-8aa7-5e31f3063c77 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:27.625783 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-c1ddc534-0e1e-425d-8aa7-5e31f3063c77 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1372 microversion: 2.1 time: 0.315464 Jun 30 10:03:27.626642 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 201/426] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:27 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1372 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:27.642364 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-e53180ac-f22e-4a83-bbb9-56a99e0a2c9b req-6aed298f-de39-460c-905b-4a52cd449659 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "114a9363-7f11-4906-959f-37a7d3275e52", "name": "network-vif-plugged", "status": "completed", "tag": "290c2729-5bcd-422d-afde-63f591011bcf"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:03:27.654249 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-e53180ac-f22e-4a83-bbb9-56a99e0a2c9b req-6aed298f-de39-460c-905b-4a52cd449659 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:27.654904 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-e53180ac-f22e-4a83-bbb9-56a99e0a2c9b req-6aed298f-de39-460c-905b-4a52cd449659 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:27.677839 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-e53180ac-f22e-4a83-bbb9-56a99e0a2c9b req-6aed298f-de39-460c-905b-4a52cd449659 service nova] Creating event network-vif-plugged:290c2729-5bcd-422d-afde-63f591011bcf for instance 114a9363-7f11-4906-959f-37a7d3275e52 on hv-cinder-84330 Jun 30 10:03:27.683631 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-e53180ac-f22e-4a83-bbb9-56a99e0a2c9b req-6aed298f-de39-460c-905b-4a52cd449659 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045756 Jun 30 10:03:27.684765 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 226/427] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:03:28.037279 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-eb7644aa-60b3-4415-a021-c0f37ea676f1 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:28.038831 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-eb7644aa-60b3-4415-a021-c0f37ea676f1 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:28.056525 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-eb7644aa-60b3-4415-a021-c0f37ea676f1 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:28.065270 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-eb7644aa-60b3-4415-a021-c0f37ea676f1 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:28.067956 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-eb7644aa-60b3-4415-a021-c0f37ea676f1 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:28.068562 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-eb7644aa-60b3-4415-a021-c0f37ea676f1 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:28.243588 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-eb7644aa-60b3-4415-a021-c0f37ea676f1 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:28.252471 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-eb7644aa-60b3-4415-a021-c0f37ea676f1 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:28.254366 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-eb7644aa-60b3-4415-a021-c0f37ea676f1 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:28.256022 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-eb7644aa-60b3-4415-a021-c0f37ea676f1 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1751 microversion: 2.20 time: 0.223229 Jun 30 10:03:28.256775 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 202/428] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:28 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1751 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:03:28.528563 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-42daae2d-30a4-4edf-a33c-830d44709d3f tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1170579311"}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:03:28.529168 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-42daae2d-30a4-4edf-a33c-830d44709d3f tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:28.535458 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-42daae2d-30a4-4edf-a33c-830d44709d3f tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:28.536213 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-42daae2d-30a4-4edf-a33c-830d44709d3f tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:28.536720 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-42daae2d-30a4-4edf-a33c-830d44709d3f tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:28.537141 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-42daae2d-30a4-4edf-a33c-830d44709d3f tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:28.642757 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-ba9fd302-b5d6-4c2a-bbc1-78e6e224b03b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:28.643489 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-ba9fd302-b5d6-4c2a-bbc1-78e6e224b03b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:28.650721 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ba9fd302-b5d6-4c2a-bbc1-78e6e224b03b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:28.651300 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ba9fd302-b5d6-4c2a-bbc1-78e6e224b03b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:28.652151 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ba9fd302-b5d6-4c2a-bbc1-78e6e224b03b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:28.652787 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ba9fd302-b5d6-4c2a-bbc1-78e6e224b03b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:28.671222 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.network.security_group_api [None req-42daae2d-30a4-4edf-a33c-830d44709d3f tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Adding security group 81cc7bba-9c83-417c-b750-cfc4d925531b to port 5b398ce3-4e1d-45ae-9288-26bcecde73b3 Jun 30 10:03:28.881039 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-ba9fd302-b5d6-4c2a-bbc1-78e6e224b03b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:28.884459 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:03:28.889774 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-ba9fd302-b5d6-4c2a-bbc1-78e6e224b03b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1372 microversion: 2.1 time: 0.250991 Jun 30 10:03:28.890535 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 203/429] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:28 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1372 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:29.281170 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-6e4cc189-0d6b-4900-a6f5-5c9ec9864389 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:29.281801 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-6e4cc189-0d6b-4900-a6f5-5c9ec9864389 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:29.292331 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-6e4cc189-0d6b-4900-a6f5-5c9ec9864389 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:29.292875 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-6e4cc189-0d6b-4900-a6f5-5c9ec9864389 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:29.293746 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-6e4cc189-0d6b-4900-a6f5-5c9ec9864389 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:29.294407 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-6e4cc189-0d6b-4900-a6f5-5c9ec9864389 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:29.347974 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-42daae2d-30a4-4edf-a33c-830d44709d3f tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "POST /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be/action" status: 202 len: 0 microversion: 2.1 time: 0.823715 Jun 30 10:03:29.348763 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 227/430] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Jun 30 10:03:28 2022] POST /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be/action => generated 0 bytes in 826 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:03:29.366752 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-ad3385a0-3a6c-4ac7-9387-de26add40b26 req-39ead6fc-e77e-4777-b473-3b18be093ad4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2766477-90ca-46bc-b411-a2d1b06b01be", "tag": "5b398ce3-4e1d-45ae-9288-26bcecde73b3"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:03:29.387500 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-ad3385a0-3a6c-4ac7-9387-de26add40b26 req-39ead6fc-e77e-4777-b473-3b18be093ad4 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:29.388123 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-ad3385a0-3a6c-4ac7-9387-de26add40b26 req-39ead6fc-e77e-4777-b473-3b18be093ad4 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:29.402592 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-ad3385a0-3a6c-4ac7-9387-de26add40b26 req-39ead6fc-e77e-4777-b473-3b18be093ad4 service nova] Creating event network-changed:5b398ce3-4e1d-45ae-9288-26bcecde73b3 for instance e2766477-90ca-46bc-b411-a2d1b06b01be on hv-cinder-84330 Jun 30 10:03:29.409179 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-ad3385a0-3a6c-4ac7-9387-de26add40b26 req-39ead6fc-e77e-4777-b473-3b18be093ad4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051430 Jun 30 10:03:29.410461 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 228/431] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:03:29.418907 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e6e58a79-269f-4431-9958-4aa87b34f69b tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:29.419894 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-e6e58a79-269f-4431-9958-4aa87b34f69b tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:29.428357 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e6e58a79-269f-4431-9958-4aa87b34f69b tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:29.438875 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e6e58a79-269f-4431-9958-4aa87b34f69b tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:29.439925 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e6e58a79-269f-4431-9958-4aa87b34f69b tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:29.440995 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e6e58a79-269f-4431-9958-4aa87b34f69b tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:29.492104 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-6e4cc189-0d6b-4900-a6f5-5c9ec9864389 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:29.502282 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-6e4cc189-0d6b-4900-a6f5-5c9ec9864389 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:29.508211 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-6e4cc189-0d6b-4900-a6f5-5c9ec9864389 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:29.510023 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-6e4cc189-0d6b-4900-a6f5-5c9ec9864389 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1751 microversion: 2.20 time: 0.232768 Jun 30 10:03:29.510871 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 204/432] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:29 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1751 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:03:29.625915 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e6e58a79-269f-4431-9958-4aa87b34f69b tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:29.635831 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-e6e58a79-269f-4431-9958-4aa87b34f69b tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1759 microversion: 2.1 time: 0.221750 Jun 30 10:03:29.635831 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 229/433] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:29 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1759 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:29.906747 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-7adda053-59fb-4004-9a5a-e8456c9fce67 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:29.907455 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-7adda053-59fb-4004-9a5a-e8456c9fce67 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:29.915205 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7adda053-59fb-4004-9a5a-e8456c9fce67 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:29.915772 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7adda053-59fb-4004-9a5a-e8456c9fce67 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:29.916635 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7adda053-59fb-4004-9a5a-e8456c9fce67 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:29.917101 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7adda053-59fb-4004-9a5a-e8456c9fce67 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:30.059903 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-7adda053-59fb-4004-9a5a-e8456c9fce67 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:30.074402 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-7adda053-59fb-4004-9a5a-e8456c9fce67 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1566 microversion: 2.1 time: 0.171415 Jun 30 10:03:30.075072 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 205/434] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:03:29 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:03:30.090344 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-b873976c-0878-4028-92f3-6a8f08b2b2d9 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:30.090861 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-b873976c-0878-4028-92f3-6a8f08b2b2d9 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:30.097351 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b873976c-0878-4028-92f3-6a8f08b2b2d9 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:30.097784 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b873976c-0878-4028-92f3-6a8f08b2b2d9 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:30.098611 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b873976c-0878-4028-92f3-6a8f08b2b2d9 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:30.099040 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b873976c-0878-4028-92f3-6a8f08b2b2d9 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:30.182693 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-b873976c-0878-4028-92f3-6a8f08b2b2d9 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095807 Jun 30 10:03:30.183465 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 230/435] 10.222.0.16 () {58 vars in 1274 bytes} [Thu Jun 30 10:03:30 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:03:30.530203 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-ec0cbf4f-703b-44d3-84c3-f38ca316dbab tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:30.531612 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-ec0cbf4f-703b-44d3-84c3-f38ca316dbab tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:30.538618 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ec0cbf4f-703b-44d3-84c3-f38ca316dbab tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:30.539227 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ec0cbf4f-703b-44d3-84c3-f38ca316dbab tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:30.540117 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ec0cbf4f-703b-44d3-84c3-f38ca316dbab tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:30.540774 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ec0cbf4f-703b-44d3-84c3-f38ca316dbab tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:30.919779 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-ec0cbf4f-703b-44d3-84c3-f38ca316dbab tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:30.928785 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-ec0cbf4f-703b-44d3-84c3-f38ca316dbab tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:30.930300 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-ec0cbf4f-703b-44d3-84c3-f38ca316dbab tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:30.931469 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-ec0cbf4f-703b-44d3-84c3-f38ca316dbab tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1751 microversion: 2.20 time: 0.405478 Jun 30 10:03:30.932049 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 206/436] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:30 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1751 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:03:31.581816 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-28ff45b0-6a1c-471c-95b4-41964ac5e481 req-171bccfa-78e1-47e8-bec0-e7982d21f043 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "114a9363-7f11-4906-959f-37a7d3275e52", "tag": "290c2729-5bcd-422d-afde-63f591011bcf"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:03:31.595556 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-28ff45b0-6a1c-471c-95b4-41964ac5e481 req-171bccfa-78e1-47e8-bec0-e7982d21f043 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:31.596495 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-28ff45b0-6a1c-471c-95b4-41964ac5e481 req-171bccfa-78e1-47e8-bec0-e7982d21f043 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:31.609332 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-28ff45b0-6a1c-471c-95b4-41964ac5e481 req-171bccfa-78e1-47e8-bec0-e7982d21f043 service nova] Creating event network-changed:290c2729-5bcd-422d-afde-63f591011bcf for instance 114a9363-7f11-4906-959f-37a7d3275e52 on hv-cinder-84330 Jun 30 10:03:31.614522 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-28ff45b0-6a1c-471c-95b4-41964ac5e481 req-171bccfa-78e1-47e8-bec0-e7982d21f043 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037941 Jun 30 10:03:31.615188 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 231/437] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:03:31.952443 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-6e12b253-b226-4d7a-a145-3fa90cc2aded tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:31.954185 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-6e12b253-b226-4d7a-a145-3fa90cc2aded tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:31.966538 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-6e12b253-b226-4d7a-a145-3fa90cc2aded tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:31.967251 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-6e12b253-b226-4d7a-a145-3fa90cc2aded tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:31.968259 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-6e12b253-b226-4d7a-a145-3fa90cc2aded tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:31.969700 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-6e12b253-b226-4d7a-a145-3fa90cc2aded tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:32.282832 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-6e12b253-b226-4d7a-a145-3fa90cc2aded tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:32.299014 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-6e12b253-b226-4d7a-a145-3fa90cc2aded tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:32.300556 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-6e12b253-b226-4d7a-a145-3fa90cc2aded tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:32.301846 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-6e12b253-b226-4d7a-a145-3fa90cc2aded tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1751 microversion: 2.20 time: 0.354760 Jun 30 10:03:32.302726 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 207/438] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:31 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1751 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:03:33.320847 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-3249d964-1178-4252-8f30-cfec48d1d939 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:33.321477 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-3249d964-1178-4252-8f30-cfec48d1d939 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:33.328467 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3249d964-1178-4252-8f30-cfec48d1d939 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:33.328925 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3249d964-1178-4252-8f30-cfec48d1d939 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:33.329672 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3249d964-1178-4252-8f30-cfec48d1d939 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:33.330096 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3249d964-1178-4252-8f30-cfec48d1d939 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:33.471539 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-3249d964-1178-4252-8f30-cfec48d1d939 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:33.481680 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-3249d964-1178-4252-8f30-cfec48d1d939 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:33.483495 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-3249d964-1178-4252-8f30-cfec48d1d939 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:33.484861 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-3249d964-1178-4252-8f30-cfec48d1d939 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1751 microversion: 2.20 time: 0.169259 Jun 30 10:03:33.485404 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 232/439] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:33 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:03:34.502909 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-969d992a-3e4f-412f-b80c-e6a9215ac468 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:34.503486 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-969d992a-3e4f-412f-b80c-e6a9215ac468 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:34.511114 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-969d992a-3e4f-412f-b80c-e6a9215ac468 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:34.511572 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-969d992a-3e4f-412f-b80c-e6a9215ac468 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:34.512423 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-969d992a-3e4f-412f-b80c-e6a9215ac468 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:34.512853 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-969d992a-3e4f-412f-b80c-e6a9215ac468 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:34.658704 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-969d992a-3e4f-412f-b80c-e6a9215ac468 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:34.668814 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-969d992a-3e4f-412f-b80c-e6a9215ac468 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:34.670729 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-969d992a-3e4f-412f-b80c-e6a9215ac468 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:34.672019 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-969d992a-3e4f-412f-b80c-e6a9215ac468 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1751 microversion: 2.20 time: 0.173174 Jun 30 10:03:34.672748 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 208/440] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:34 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1751 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:03:35.690934 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-bb2ad015-f576-4e57-b8a1-49bf40d1c907 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:35.691539 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-bb2ad015-f576-4e57-b8a1-49bf40d1c907 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:35.698985 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bb2ad015-f576-4e57-b8a1-49bf40d1c907 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:35.699424 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bb2ad015-f576-4e57-b8a1-49bf40d1c907 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:35.700277 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bb2ad015-f576-4e57-b8a1-49bf40d1c907 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:35.700702 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bb2ad015-f576-4e57-b8a1-49bf40d1c907 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:35.842887 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-bb2ad015-f576-4e57-b8a1-49bf40d1c907 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:35.854972 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-bb2ad015-f576-4e57-b8a1-49bf40d1c907 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:35.856500 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-bb2ad015-f576-4e57-b8a1-49bf40d1c907 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:35.857674 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-bb2ad015-f576-4e57-b8a1-49bf40d1c907 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1751 microversion: 2.20 time: 0.170689 Jun 30 10:03:35.858227 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 233/441] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:35 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1751 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:03:36.877297 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-7779ebe2-e6c1-4ff4-8145-25820a9cc2bc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:36.878877 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-7779ebe2-e6c1-4ff4-8145-25820a9cc2bc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:36.886769 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7779ebe2-e6c1-4ff4-8145-25820a9cc2bc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:36.887299 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7779ebe2-e6c1-4ff4-8145-25820a9cc2bc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:36.888430 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7779ebe2-e6c1-4ff4-8145-25820a9cc2bc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:36.889057 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7779ebe2-e6c1-4ff4-8145-25820a9cc2bc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:37.074148 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-7779ebe2-e6c1-4ff4-8145-25820a9cc2bc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:37.093342 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-7779ebe2-e6c1-4ff4-8145-25820a9cc2bc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:37.095289 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-7779ebe2-e6c1-4ff4-8145-25820a9cc2bc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:37.096643 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-7779ebe2-e6c1-4ff4-8145-25820a9cc2bc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1751 microversion: 2.20 time: 0.223659 Jun 30 10:03:37.097263 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 209/442] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:36 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1751 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:03:38.115931 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-740a536d-49ba-4dae-b5ef-b82a12bccc27 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:38.116566 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-740a536d-49ba-4dae-b5ef-b82a12bccc27 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:38.123394 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-740a536d-49ba-4dae-b5ef-b82a12bccc27 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:38.123828 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-740a536d-49ba-4dae-b5ef-b82a12bccc27 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:38.124596 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-740a536d-49ba-4dae-b5ef-b82a12bccc27 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:38.125012 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-740a536d-49ba-4dae-b5ef-b82a12bccc27 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:38.266696 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-740a536d-49ba-4dae-b5ef-b82a12bccc27 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:38.276747 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-740a536d-49ba-4dae-b5ef-b82a12bccc27 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:38.278332 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-740a536d-49ba-4dae-b5ef-b82a12bccc27 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:38.279528 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-740a536d-49ba-4dae-b5ef-b82a12bccc27 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1753 microversion: 2.20 time: 0.167637 Jun 30 10:03:38.280141 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 234/443] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:38 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:03:39.302250 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-353ac94b-8698-4021-b56b-2a74d9085030 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:39.302944 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-353ac94b-8698-4021-b56b-2a74d9085030 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:39.309771 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-353ac94b-8698-4021-b56b-2a74d9085030 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:39.310286 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-353ac94b-8698-4021-b56b-2a74d9085030 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:39.311101 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-353ac94b-8698-4021-b56b-2a74d9085030 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:39.311589 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-353ac94b-8698-4021-b56b-2a74d9085030 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:39.526286 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-353ac94b-8698-4021-b56b-2a74d9085030 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:39.535489 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-353ac94b-8698-4021-b56b-2a74d9085030 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:39.537266 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-353ac94b-8698-4021-b56b-2a74d9085030 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:39.538429 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-353ac94b-8698-4021-b56b-2a74d9085030 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1809 microversion: 2.20 time: 0.240008 Jun 30 10:03:39.539321 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 210/444] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:39 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1809 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:03:40.556457 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-74e506e7-ecf3-4c21-9bf2-be5303aca4a3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:40.557400 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-74e506e7-ecf3-4c21-9bf2-be5303aca4a3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:40.564215 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-74e506e7-ecf3-4c21-9bf2-be5303aca4a3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:40.564614 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-74e506e7-ecf3-4c21-9bf2-be5303aca4a3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:40.565579 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-74e506e7-ecf3-4c21-9bf2-be5303aca4a3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:40.566231 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-74e506e7-ecf3-4c21-9bf2-be5303aca4a3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:40.713291 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-74e506e7-ecf3-4c21-9bf2-be5303aca4a3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:40.722245 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-74e506e7-ecf3-4c21-9bf2-be5303aca4a3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:40.723749 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-74e506e7-ecf3-4c21-9bf2-be5303aca4a3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:40.724956 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-74e506e7-ecf3-4c21-9bf2-be5303aca4a3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1809 microversion: 2.20 time: 0.172493 Jun 30 10:03:40.725522 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 235/445] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:40 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:03:41.745830 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-13466553-0c42-4c05-8627-abfceea15b8c tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:41.746457 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-13466553-0c42-4c05-8627-abfceea15b8c tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:41.753530 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-13466553-0c42-4c05-8627-abfceea15b8c tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:41.753975 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-13466553-0c42-4c05-8627-abfceea15b8c tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:41.754742 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-13466553-0c42-4c05-8627-abfceea15b8c tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:41.757566 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-13466553-0c42-4c05-8627-abfceea15b8c tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:41.899723 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-13466553-0c42-4c05-8627-abfceea15b8c tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:41.908967 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-13466553-0c42-4c05-8627-abfceea15b8c tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:41.910478 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-13466553-0c42-4c05-8627-abfceea15b8c tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:41.911645 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-13466553-0c42-4c05-8627-abfceea15b8c tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1809 microversion: 2.20 time: 0.171042 Jun 30 10:03:41.912202 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 211/446] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:41 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:03:42.931027 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-a153be08-e768-4b9c-a9f5-ef2650a15a55 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:42.931624 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-a153be08-e768-4b9c-a9f5-ef2650a15a55 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:42.938444 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a153be08-e768-4b9c-a9f5-ef2650a15a55 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:42.938879 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a153be08-e768-4b9c-a9f5-ef2650a15a55 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:42.939634 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a153be08-e768-4b9c-a9f5-ef2650a15a55 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:42.940092 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a153be08-e768-4b9c-a9f5-ef2650a15a55 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:43.075967 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-a153be08-e768-4b9c-a9f5-ef2650a15a55 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:43.084630 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-a153be08-e768-4b9c-a9f5-ef2650a15a55 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:43.086254 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-a153be08-e768-4b9c-a9f5-ef2650a15a55 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:43.087440 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-a153be08-e768-4b9c-a9f5-ef2650a15a55 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1809 microversion: 2.20 time: 0.160583 Jun 30 10:03:43.088019 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 236/447] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:42 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:03:44.105814 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-c96926d8-f467-4d2f-8eeb-a54dce696f8d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:44.106752 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-c96926d8-f467-4d2f-8eeb-a54dce696f8d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:44.113729 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c96926d8-f467-4d2f-8eeb-a54dce696f8d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:44.114152 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c96926d8-f467-4d2f-8eeb-a54dce696f8d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:44.114910 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c96926d8-f467-4d2f-8eeb-a54dce696f8d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:44.115332 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c96926d8-f467-4d2f-8eeb-a54dce696f8d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:44.257173 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-c96926d8-f467-4d2f-8eeb-a54dce696f8d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:44.265984 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-c96926d8-f467-4d2f-8eeb-a54dce696f8d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:44.267735 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-c96926d8-f467-4d2f-8eeb-a54dce696f8d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:44.268910 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-c96926d8-f467-4d2f-8eeb-a54dce696f8d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1809 microversion: 2.20 time: 0.167267 Jun 30 10:03:44.269506 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 212/448] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:44 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:03:44.573235 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-6aa621de-d89c-46bc-9747-7ae522000f13 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "612c455b-7ebb-4ff3-bc75-37a6779dd975", "device": "/dev/sdb"}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:03:44.574891 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-6aa621de-d89c-46bc-9747-7ae522000f13 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 8e2cdb14-25e9-4273-9606-a2c458b4ebd2] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:44.581551 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6aa621de-d89c-46bc-9747-7ae522000f13 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:44.581986 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6aa621de-d89c-46bc-9747-7ae522000f13 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:44.582732 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6aa621de-d89c-46bc-9747-7ae522000f13 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:44.583204 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6aa621de-d89c-46bc-9747-7ae522000f13 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:45.287988 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-73af60ac-0d7c-4d32-9aa9-d0d5dbc69955 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:45.289769 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-73af60ac-0d7c-4d32-9aa9-d0d5dbc69955 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:45.301539 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-73af60ac-0d7c-4d32-9aa9-d0d5dbc69955 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:45.301957 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-73af60ac-0d7c-4d32-9aa9-d0d5dbc69955 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:45.304543 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-73af60ac-0d7c-4d32-9aa9-d0d5dbc69955 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:45.305138 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-73af60ac-0d7c-4d32-9aa9-d0d5dbc69955 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:45.464570 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-73af60ac-0d7c-4d32-9aa9-d0d5dbc69955 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:45.474065 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-73af60ac-0d7c-4d32-9aa9-d0d5dbc69955 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:45.475578 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-73af60ac-0d7c-4d32-9aa9-d0d5dbc69955 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:45.476842 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-73af60ac-0d7c-4d32-9aa9-d0d5dbc69955 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1809 microversion: 2.20 time: 0.193315 Jun 30 10:03:45.477400 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 213/449] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:45 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1809 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:03:46.495271 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-83fef3d3-da03-4159-983f-f436da717779 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:46.496010 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-83fef3d3-da03-4159-983f-f436da717779 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:46.502999 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-83fef3d3-da03-4159-983f-f436da717779 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:46.503446 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-83fef3d3-da03-4159-983f-f436da717779 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:46.504274 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-83fef3d3-da03-4159-983f-f436da717779 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:46.504667 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-83fef3d3-da03-4159-983f-f436da717779 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:46.653034 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-83fef3d3-da03-4159-983f-f436da717779 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:46.663000 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-83fef3d3-da03-4159-983f-f436da717779 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:46.665330 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-83fef3d3-da03-4159-983f-f436da717779 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:46.666504 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-83fef3d3-da03-4159-983f-f436da717779 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1809 microversion: 2.20 time: 0.175280 Jun 30 10:03:46.667028 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 214/450] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:46 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:03:47.686072 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-ee08e69f-5e47-403d-9567-dbc2889453d6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:47.686744 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-ee08e69f-5e47-403d-9567-dbc2889453d6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:47.689218 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_api:SELECT=55 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:03:47.698479 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ee08e69f-5e47-403d-9567-dbc2889453d6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:47.699113 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ee08e69f-5e47-403d-9567-dbc2889453d6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:47.699982 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ee08e69f-5e47-403d-9567-dbc2889453d6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:47.700424 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ee08e69f-5e47-403d-9567-dbc2889453d6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:47.839657 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-ee08e69f-5e47-403d-9567-dbc2889453d6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:47.848383 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-ee08e69f-5e47-403d-9567-dbc2889453d6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:47.849926 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-ee08e69f-5e47-403d-9567-dbc2889453d6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:47.851327 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-ee08e69f-5e47-403d-9567-dbc2889453d6 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1809 microversion: 2.20 time: 0.170438 Jun 30 10:03:47.851889 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 215/451] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:47 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:03:48.869696 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-aaf05792-c852-4724-956e-754001575e2f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:48.870404 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-aaf05792-c852-4724-956e-754001575e2f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:48.877216 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-aaf05792-c852-4724-956e-754001575e2f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:48.877665 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-aaf05792-c852-4724-956e-754001575e2f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:48.878492 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-aaf05792-c852-4724-956e-754001575e2f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:48.878932 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-aaf05792-c852-4724-956e-754001575e2f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:49.014813 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-aaf05792-c852-4724-956e-754001575e2f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:49.023433 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-aaf05792-c852-4724-956e-754001575e2f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:49.025034 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-aaf05792-c852-4724-956e-754001575e2f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:49.026186 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-aaf05792-c852-4724-956e-754001575e2f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1809 microversion: 2.20 time: 0.160452 Jun 30 10:03:49.026740 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 216/452] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:48 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:03:50.044761 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-3539f85e-ccf7-4942-bd6d-6821c1133b93 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:50.045503 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-3539f85e-ccf7-4942-bd6d-6821c1133b93 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:50.052193 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3539f85e-ccf7-4942-bd6d-6821c1133b93 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:50.052637 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3539f85e-ccf7-4942-bd6d-6821c1133b93 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:50.053397 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3539f85e-ccf7-4942-bd6d-6821c1133b93 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:50.053820 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3539f85e-ccf7-4942-bd6d-6821c1133b93 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:50.210820 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-3539f85e-ccf7-4942-bd6d-6821c1133b93 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:50.221714 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-3539f85e-ccf7-4942-bd6d-6821c1133b93 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:50.223951 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-3539f85e-ccf7-4942-bd6d-6821c1133b93 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:50.225648 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-3539f85e-ccf7-4942-bd6d-6821c1133b93 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1809 microversion: 2.20 time: 0.184653 Jun 30 10:03:50.233310 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 217/453] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:50 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:03:51.244267 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-3d3d626e-5889-4031-a8f3-1b32ad3db22a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:51.244960 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-3d3d626e-5889-4031-a8f3-1b32ad3db22a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:51.252898 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3d3d626e-5889-4031-a8f3-1b32ad3db22a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:51.253746 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3d3d626e-5889-4031-a8f3-1b32ad3db22a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:51.254721 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3d3d626e-5889-4031-a8f3-1b32ad3db22a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:51.255142 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3d3d626e-5889-4031-a8f3-1b32ad3db22a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:51.398668 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-3d3d626e-5889-4031-a8f3-1b32ad3db22a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:51.407249 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-3d3d626e-5889-4031-a8f3-1b32ad3db22a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:51.408766 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-3d3d626e-5889-4031-a8f3-1b32ad3db22a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:51.409907 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-3d3d626e-5889-4031-a8f3-1b32ad3db22a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1809 microversion: 2.20 time: 0.169538 Jun 30 10:03:51.410453 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 218/454] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:51 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:03:52.432773 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-bedc5d7f-274f-4678-9a32-023572ed2807 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:52.433724 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-bedc5d7f-274f-4678-9a32-023572ed2807 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:52.445206 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-bedc5d7f-274f-4678-9a32-023572ed2807 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:52.445653 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-bedc5d7f-274f-4678-9a32-023572ed2807 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:52.446404 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-bedc5d7f-274f-4678-9a32-023572ed2807 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:52.446828 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-bedc5d7f-274f-4678-9a32-023572ed2807 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:52.591065 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-bedc5d7f-274f-4678-9a32-023572ed2807 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:52.603229 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-bedc5d7f-274f-4678-9a32-023572ed2807 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:52.604877 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-bedc5d7f-274f-4678-9a32-023572ed2807 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:52.606021 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-bedc5d7f-274f-4678-9a32-023572ed2807 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1809 microversion: 2.20 time: 0.179815 Jun 30 10:03:52.606613 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 219/455] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:52 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:03:52.797382 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-6aa621de-d89c-46bc-9747-7ae522000f13 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "POST /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.228120 Jun 30 10:03:52.798021 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 237/456] 10.222.0.16 () {60 vars in 1322 bytes} [Thu Jun 30 10:03:44 2022] POST /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2/os-volume_attachments => generated 194 bytes in 8230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:03:53.629983 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-f3678435-8e85-4aff-ab48-6410fb5c262a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:53.630600 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-f3678435-8e85-4aff-ab48-6410fb5c262a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:53.637587 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-f3678435-8e85-4aff-ab48-6410fb5c262a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:53.638026 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-f3678435-8e85-4aff-ab48-6410fb5c262a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:53.638799 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-f3678435-8e85-4aff-ab48-6410fb5c262a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:53.639223 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-f3678435-8e85-4aff-ab48-6410fb5c262a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:53.659326 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell1:SELECT=100 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:03:53.777289 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-f3678435-8e85-4aff-ab48-6410fb5c262a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:53.791411 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-f3678435-8e85-4aff-ab48-6410fb5c262a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:53.794114 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-f3678435-8e85-4aff-ab48-6410fb5c262a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:53.795920 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-f3678435-8e85-4aff-ab48-6410fb5c262a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1809 microversion: 2.20 time: 0.169685 Jun 30 10:03:53.796728 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 220/457] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:53 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:03:54.815118 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=63 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:03:54.821910 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-60b32d4f-e749-451a-9f43-5cba67ab0e38 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:54.822630 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-60b32d4f-e749-451a-9f43-5cba67ab0e38 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:54.830135 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-60b32d4f-e749-451a-9f43-5cba67ab0e38 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:54.830576 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-60b32d4f-e749-451a-9f43-5cba67ab0e38 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:54.831329 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-60b32d4f-e749-451a-9f43-5cba67ab0e38 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:54.831758 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-60b32d4f-e749-451a-9f43-5cba67ab0e38 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:54.965634 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-60b32d4f-e749-451a-9f43-5cba67ab0e38 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:54.974099 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-60b32d4f-e749-451a-9f43-5cba67ab0e38 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:54.975657 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-60b32d4f-e749-451a-9f43-5cba67ab0e38 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:54.977301 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-60b32d4f-e749-451a-9f43-5cba67ab0e38 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1809 microversion: 2.20 time: 0.164527 Jun 30 10:03:54.977934 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 238/458] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:54 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:03:55.997185 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-8977bee7-3e5e-4edc-b538-424cafc29e20 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:55.997769 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-8977bee7-3e5e-4edc-b538-424cafc29e20 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:56.004515 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8977bee7-3e5e-4edc-b538-424cafc29e20 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:56.004967 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8977bee7-3e5e-4edc-b538-424cafc29e20 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:56.005719 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8977bee7-3e5e-4edc-b538-424cafc29e20 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:56.006144 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8977bee7-3e5e-4edc-b538-424cafc29e20 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:56.140183 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-8977bee7-3e5e-4edc-b538-424cafc29e20 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:56.150640 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-8977bee7-3e5e-4edc-b538-424cafc29e20 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:56.152170 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-8977bee7-3e5e-4edc-b538-424cafc29e20 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:56.153331 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-8977bee7-3e5e-4edc-b538-424cafc29e20 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1809 microversion: 2.20 time: 0.161319 Jun 30 10:03:56.153932 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 221/459] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:55 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:03:57.171349 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-1fdc0f13-0cbe-4555-8ee9-d813619abc77 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:57.171984 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-1fdc0f13-0cbe-4555-8ee9-d813619abc77 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:57.178190 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1fdc0f13-0cbe-4555-8ee9-d813619abc77 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:57.178667 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1fdc0f13-0cbe-4555-8ee9-d813619abc77 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:57.179430 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1fdc0f13-0cbe-4555-8ee9-d813619abc77 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:57.179884 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1fdc0f13-0cbe-4555-8ee9-d813619abc77 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:57.184774 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:03:57.324984 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-1fdc0f13-0cbe-4555-8ee9-d813619abc77 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:57.333767 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-1fdc0f13-0cbe-4555-8ee9-d813619abc77 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:57.335388 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-1fdc0f13-0cbe-4555-8ee9-d813619abc77 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:57.336853 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-1fdc0f13-0cbe-4555-8ee9-d813619abc77 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1809 microversion: 2.20 time: 0.169583 Jun 30 10:03:57.337648 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 239/460] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:57 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:03:58.354825 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-047ee7ec-6cee-45e8-b596-f0fabecc9883 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:58.355433 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-047ee7ec-6cee-45e8-b596-f0fabecc9883 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:58.362184 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-047ee7ec-6cee-45e8-b596-f0fabecc9883 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:58.362632 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-047ee7ec-6cee-45e8-b596-f0fabecc9883 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:58.363385 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-047ee7ec-6cee-45e8-b596-f0fabecc9883 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:58.363821 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-047ee7ec-6cee-45e8-b596-f0fabecc9883 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:58.496958 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-047ee7ec-6cee-45e8-b596-f0fabecc9883 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:58.505572 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-047ee7ec-6cee-45e8-b596-f0fabecc9883 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:58.507073 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-047ee7ec-6cee-45e8-b596-f0fabecc9883 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:58.508310 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-047ee7ec-6cee-45e8-b596-f0fabecc9883 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1809 microversion: 2.20 time: 0.157530 Jun 30 10:03:58.508831 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 222/461] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:58 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:03:59.531532 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-9d1b8304-6dc3-48f2-b80d-4d0b7a4b6e09 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:03:59.532567 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-9d1b8304-6dc3-48f2-b80d-4d0b7a4b6e09 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:03:59.543561 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9d1b8304-6dc3-48f2-b80d-4d0b7a4b6e09 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:59.544343 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9d1b8304-6dc3-48f2-b80d-4d0b7a4b6e09 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:59.545579 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9d1b8304-6dc3-48f2-b80d-4d0b7a4b6e09 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:03:59.546287 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9d1b8304-6dc3-48f2-b80d-4d0b7a4b6e09 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:03:59.686805 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-9d1b8304-6dc3-48f2-b80d-4d0b7a4b6e09 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:59.700703 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-9d1b8304-6dc3-48f2-b80d-4d0b7a4b6e09 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:59.702882 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-9d1b8304-6dc3-48f2-b80d-4d0b7a4b6e09 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:03:59.704695 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-9d1b8304-6dc3-48f2-b80d-4d0b7a4b6e09 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1809 microversion: 2.20 time: 0.179972 Jun 30 10:03:59.705464 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 240/462] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:03:59 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:04:00.728201 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-a795f084-96ad-4815-9c70-5143e4767e7b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:00.728800 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-a795f084-96ad-4815-9c70-5143e4767e7b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:00.736609 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a795f084-96ad-4815-9c70-5143e4767e7b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:00.737099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a795f084-96ad-4815-9c70-5143e4767e7b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:00.737950 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a795f084-96ad-4815-9c70-5143e4767e7b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:00.738394 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a795f084-96ad-4815-9c70-5143e4767e7b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:00.881992 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-a795f084-96ad-4815-9c70-5143e4767e7b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:00.890896 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-a795f084-96ad-4815-9c70-5143e4767e7b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:00.892439 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-a795f084-96ad-4815-9c70-5143e4767e7b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:00.893594 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-a795f084-96ad-4815-9c70-5143e4767e7b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1809 microversion: 2.20 time: 0.171708 Jun 30 10:04:00.894143 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 223/463] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:04:00 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:04:01.916363 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-8700cfda-f5e1-40c0-8ab9-52c22b0918dd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:01.917219 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-8700cfda-f5e1-40c0-8ab9-52c22b0918dd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:01.928342 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8700cfda-f5e1-40c0-8ab9-52c22b0918dd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:01.929117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8700cfda-f5e1-40c0-8ab9-52c22b0918dd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:01.930277 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8700cfda-f5e1-40c0-8ab9-52c22b0918dd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:01.930711 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8700cfda-f5e1-40c0-8ab9-52c22b0918dd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:02.065166 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-8700cfda-f5e1-40c0-8ab9-52c22b0918dd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:02.074574 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-8700cfda-f5e1-40c0-8ab9-52c22b0918dd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:02.076136 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-8700cfda-f5e1-40c0-8ab9-52c22b0918dd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:02.077276 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-8700cfda-f5e1-40c0-8ab9-52c22b0918dd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1809 microversion: 2.20 time: 0.167826 Jun 30 10:04:02.077834 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 241/464] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:04:01 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:04:03.099750 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-9b96af90-b30e-4832-8aba-c17edb0558b0 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:03.101803 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-9b96af90-b30e-4832-8aba-c17edb0558b0 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:03.108987 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9b96af90-b30e-4832-8aba-c17edb0558b0 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:03.109442 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9b96af90-b30e-4832-8aba-c17edb0558b0 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:03.110277 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9b96af90-b30e-4832-8aba-c17edb0558b0 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:03.110712 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9b96af90-b30e-4832-8aba-c17edb0558b0 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:03.245516 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-9b96af90-b30e-4832-8aba-c17edb0558b0 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:03.259489 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-9b96af90-b30e-4832-8aba-c17edb0558b0 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:03.261884 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-9b96af90-b30e-4832-8aba-c17edb0558b0 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:03.263606 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-9b96af90-b30e-4832-8aba-c17edb0558b0 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1809 microversion: 2.20 time: 0.170059 Jun 30 10:04:03.264426 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 224/465] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:04:03 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:04:03.540450 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 10:04:03.540771 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Thu Jun 30 10:04:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 10:04:04.288565 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e4b17b3a-aa68-43e6-b8e4-d549c3f76a64 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:04.289486 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-e4b17b3a-aa68-43e6-b8e4-d549c3f76a64 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:04.300596 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e4b17b3a-aa68-43e6-b8e4-d549c3f76a64 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:04.301333 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e4b17b3a-aa68-43e6-b8e4-d549c3f76a64 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:04.302592 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e4b17b3a-aa68-43e6-b8e4-d549c3f76a64 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:04.303309 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e4b17b3a-aa68-43e6-b8e4-d549c3f76a64 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:04.443055 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e4b17b3a-aa68-43e6-b8e4-d549c3f76a64 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:04.452078 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e4b17b3a-aa68-43e6-b8e4-d549c3f76a64 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:04.453599 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e4b17b3a-aa68-43e6-b8e4-d549c3f76a64 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:04.454758 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-e4b17b3a-aa68-43e6-b8e4-d549c3f76a64 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1809 microversion: 2.20 time: 0.172804 Jun 30 10:04:04.455306 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 242/466] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:04:04 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:04:05.473308 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-95c589c7-eb89-40a2-a0ba-5cd66bd42c84 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:05.473909 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-95c589c7-eb89-40a2-a0ba-5cd66bd42c84 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:05.480974 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-95c589c7-eb89-40a2-a0ba-5cd66bd42c84 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:05.481415 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-95c589c7-eb89-40a2-a0ba-5cd66bd42c84 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:05.482174 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-95c589c7-eb89-40a2-a0ba-5cd66bd42c84 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:05.482619 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-95c589c7-eb89-40a2-a0ba-5cd66bd42c84 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:05.623156 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-95c589c7-eb89-40a2-a0ba-5cd66bd42c84 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:05.631603 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-95c589c7-eb89-40a2-a0ba-5cd66bd42c84 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:05.633144 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-95c589c7-eb89-40a2-a0ba-5cd66bd42c84 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:05.634314 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-95c589c7-eb89-40a2-a0ba-5cd66bd42c84 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1809 microversion: 2.20 time: 0.165066 Jun 30 10:04:05.634857 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 225/467] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:04:05 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:04:06.654355 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-db492b93-38f3-4a84-912d-0337e851c6ca tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:06.655065 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-db492b93-38f3-4a84-912d-0337e851c6ca tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:06.663617 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-db492b93-38f3-4a84-912d-0337e851c6ca tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:06.664210 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-db492b93-38f3-4a84-912d-0337e851c6ca tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:06.665177 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-db492b93-38f3-4a84-912d-0337e851c6ca tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:06.665599 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-db492b93-38f3-4a84-912d-0337e851c6ca tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:06.815706 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-db492b93-38f3-4a84-912d-0337e851c6ca tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:06.825896 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-db492b93-38f3-4a84-912d-0337e851c6ca tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:06.827623 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-db492b93-38f3-4a84-912d-0337e851c6ca tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:06.829083 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-db492b93-38f3-4a84-912d-0337e851c6ca tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1809 microversion: 2.20 time: 0.179506 Jun 30 10:04:06.829454 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 243/468] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:04:06 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:04:07.851619 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-89e2e4ed-63c3-42a4-b92b-c581aa4d9198 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:07.852574 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-89e2e4ed-63c3-42a4-b92b-c581aa4d9198 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:07.863532 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-89e2e4ed-63c3-42a4-b92b-c581aa4d9198 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:07.864332 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-89e2e4ed-63c3-42a4-b92b-c581aa4d9198 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:07.865585 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-89e2e4ed-63c3-42a4-b92b-c581aa4d9198 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:07.866306 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-89e2e4ed-63c3-42a4-b92b-c581aa4d9198 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:08.006098 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-89e2e4ed-63c3-42a4-b92b-c581aa4d9198 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:08.019214 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-89e2e4ed-63c3-42a4-b92b-c581aa4d9198 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:08.021592 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-89e2e4ed-63c3-42a4-b92b-c581aa4d9198 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:08.023364 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-89e2e4ed-63c3-42a4-b92b-c581aa4d9198 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1809 microversion: 2.20 time: 0.177991 Jun 30 10:04:08.024037 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 226/469] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:04:07 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:04:09.042942 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f793d4e4-e4a5-4d2b-a134-e9bc0af200e3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:09.043666 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f793d4e4-e4a5-4d2b-a134-e9bc0af200e3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:09.050971 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f793d4e4-e4a5-4d2b-a134-e9bc0af200e3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:09.051512 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f793d4e4-e4a5-4d2b-a134-e9bc0af200e3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:09.052425 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f793d4e4-e4a5-4d2b-a134-e9bc0af200e3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:09.052930 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f793d4e4-e4a5-4d2b-a134-e9bc0af200e3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:09.142267 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [req-4509ea52-6bc5-4c49-8183-8777a67fccf3 req-1330dfda-0fb6-43b8-8200-3876d365bf49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c15c69f-e851-41aa-9f31-0e897b2f302d", "name": "network-vif-plugged", "status": "completed", "tag": "c1be8ae5-cf30-4b83-be1b-6a94517a895b"}]} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:04:09.152626 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-4509ea52-6bc5-4c49-8183-8777a67fccf3 req-1330dfda-0fb6-43b8-8200-3876d365bf49 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:09.153134 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-4509ea52-6bc5-4c49-8183-8777a67fccf3 req-1330dfda-0fb6-43b8-8200-3876d365bf49 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:09.165592 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.compute.server_external_events [req-4509ea52-6bc5-4c49-8183-8777a67fccf3 req-1330dfda-0fb6-43b8-8200-3876d365bf49 service nova] Creating event network-vif-plugged:c1be8ae5-cf30-4b83-be1b-6a94517a895b for instance 8c15c69f-e851-41aa-9f31-0e897b2f302d on hv-cinder-84330 Jun 30 10:04:09.171424 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [req-4509ea52-6bc5-4c49-8183-8777a67fccf3 req-1330dfda-0fb6-43b8-8200-3876d365bf49 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033580 Jun 30 10:04:09.172559 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 227/470] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:04:09.198605 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f793d4e4-e4a5-4d2b-a134-e9bc0af200e3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:09.207724 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f793d4e4-e4a5-4d2b-a134-e9bc0af200e3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:09.209420 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f793d4e4-e4a5-4d2b-a134-e9bc0af200e3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:09.210609 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f793d4e4-e4a5-4d2b-a134-e9bc0af200e3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1809 microversion: 2.20 time: 0.172387 Jun 30 10:04:09.211503 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 244/471] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:04:09 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:04:10.231048 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-084e5506-caec-4434-9d23-0b1c8be04435 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:10.231726 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-084e5506-caec-4434-9d23-0b1c8be04435 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:10.238328 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-084e5506-caec-4434-9d23-0b1c8be04435 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:10.238761 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-084e5506-caec-4434-9d23-0b1c8be04435 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:10.239505 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-084e5506-caec-4434-9d23-0b1c8be04435 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:10.239955 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-084e5506-caec-4434-9d23-0b1c8be04435 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:10.381444 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-084e5506-caec-4434-9d23-0b1c8be04435 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:10.393964 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-084e5506-caec-4434-9d23-0b1c8be04435 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:10.396355 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-084e5506-caec-4434-9d23-0b1c8be04435 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:10.398138 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-084e5506-caec-4434-9d23-0b1c8be04435 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1809 microversion: 2.20 time: 0.171672 Jun 30 10:04:10.398880 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 228/472] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:04:10 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:04:11.421056 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-bb28fd06-4585-4365-9e8a-378a8b18862f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:11.421911 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-bb28fd06-4585-4365-9e8a-378a8b18862f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:11.432336 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bb28fd06-4585-4365-9e8a-378a8b18862f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:11.432783 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bb28fd06-4585-4365-9e8a-378a8b18862f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:11.433553 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bb28fd06-4585-4365-9e8a-378a8b18862f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:11.433982 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bb28fd06-4585-4365-9e8a-378a8b18862f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:11.573106 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-bb28fd06-4585-4365-9e8a-378a8b18862f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:11.582667 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-bb28fd06-4585-4365-9e8a-378a8b18862f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:11.584533 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-bb28fd06-4585-4365-9e8a-378a8b18862f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:11.585671 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-bb28fd06-4585-4365-9e8a-378a8b18862f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1809 microversion: 2.20 time: 0.171415 Jun 30 10:04:11.586220 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 245/473] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:04:11 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:04:12.606341 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-06e6bc88-5e2f-4a28-b842-38078e3b8adb tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:12.607243 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-06e6bc88-5e2f-4a28-b842-38078e3b8adb tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:12.614687 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-06e6bc88-5e2f-4a28-b842-38078e3b8adb tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:12.615123 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-06e6bc88-5e2f-4a28-b842-38078e3b8adb tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:12.615897 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-06e6bc88-5e2f-4a28-b842-38078e3b8adb tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:12.616330 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-06e6bc88-5e2f-4a28-b842-38078e3b8adb tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:12.749066 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-06e6bc88-5e2f-4a28-b842-38078e3b8adb tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:12.757568 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-06e6bc88-5e2f-4a28-b842-38078e3b8adb tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:12.759090 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-06e6bc88-5e2f-4a28-b842-38078e3b8adb tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:12.760261 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-06e6bc88-5e2f-4a28-b842-38078e3b8adb tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1809 microversion: 2.20 time: 0.158756 Jun 30 10:04:12.760845 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 229/474] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:04:12 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:04:13.779335 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-48e0ba43-1463-4593-bd23-e75240708154 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:13.779964 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-48e0ba43-1463-4593-bd23-e75240708154 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:13.786817 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-48e0ba43-1463-4593-bd23-e75240708154 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:13.787267 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-48e0ba43-1463-4593-bd23-e75240708154 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:13.788066 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-48e0ba43-1463-4593-bd23-e75240708154 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:13.788494 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-48e0ba43-1463-4593-bd23-e75240708154 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:13.921805 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-48e0ba43-1463-4593-bd23-e75240708154 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:13.932029 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-48e0ba43-1463-4593-bd23-e75240708154 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:13.933592 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-48e0ba43-1463-4593-bd23-e75240708154 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:13.934741 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-48e0ba43-1463-4593-bd23-e75240708154 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1809 microversion: 2.20 time: 0.159662 Jun 30 10:04:13.935285 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 246/475] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:04:13 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:04:14.958115 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-cdfd2bf3-f7e8-4e2e-a0dc-3330f1bda0d9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:14.959093 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-cdfd2bf3-f7e8-4e2e-a0dc-3330f1bda0d9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:14.970286 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-cdfd2bf3-f7e8-4e2e-a0dc-3330f1bda0d9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:14.971016 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-cdfd2bf3-f7e8-4e2e-a0dc-3330f1bda0d9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:14.972306 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-cdfd2bf3-f7e8-4e2e-a0dc-3330f1bda0d9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:14.973017 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-cdfd2bf3-f7e8-4e2e-a0dc-3330f1bda0d9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:15.113381 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-cdfd2bf3-f7e8-4e2e-a0dc-3330f1bda0d9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:15.121975 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-cdfd2bf3-f7e8-4e2e-a0dc-3330f1bda0d9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:15.123471 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-cdfd2bf3-f7e8-4e2e-a0dc-3330f1bda0d9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:15.124661 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-cdfd2bf3-f7e8-4e2e-a0dc-3330f1bda0d9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1809 microversion: 2.20 time: 0.173033 Jun 30 10:04:15.125217 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 230/476] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:04:14 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:04:16.146708 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-db995236-0adc-4761-abb2-f369f2175470 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:16.147725 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-db995236-0adc-4761-abb2-f369f2175470 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:16.155965 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-db995236-0adc-4761-abb2-f369f2175470 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:16.156378 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-db995236-0adc-4761-abb2-f369f2175470 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:16.157131 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-db995236-0adc-4761-abb2-f369f2175470 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:16.157557 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-db995236-0adc-4761-abb2-f369f2175470 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:16.298015 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-db995236-0adc-4761-abb2-f369f2175470 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:16.306475 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-db995236-0adc-4761-abb2-f369f2175470 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:16.308035 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-db995236-0adc-4761-abb2-f369f2175470 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:16.309183 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-db995236-0adc-4761-abb2-f369f2175470 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1809 microversion: 2.20 time: 0.169007 Jun 30 10:04:16.309713 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 247/477] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:04:16 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:04:17.332202 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-79ea761a-43b6-4f24-a401-22d101e0bb80 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:17.332801 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-79ea761a-43b6-4f24-a401-22d101e0bb80 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:17.339967 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-79ea761a-43b6-4f24-a401-22d101e0bb80 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:17.340418 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-79ea761a-43b6-4f24-a401-22d101e0bb80 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:17.341174 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-79ea761a-43b6-4f24-a401-22d101e0bb80 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:17.341602 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-79ea761a-43b6-4f24-a401-22d101e0bb80 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:17.495994 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-79ea761a-43b6-4f24-a401-22d101e0bb80 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:17.504793 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-79ea761a-43b6-4f24-a401-22d101e0bb80 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:17.506362 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-79ea761a-43b6-4f24-a401-22d101e0bb80 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:17.507529 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-79ea761a-43b6-4f24-a401-22d101e0bb80 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1809 microversion: 2.20 time: 0.179344 Jun 30 10:04:17.508083 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 231/478] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:04:17 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:04:18.526214 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-6223b974-0339-4783-8192-c0588ab31b7a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:18.526810 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-6223b974-0339-4783-8192-c0588ab31b7a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:18.533952 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6223b974-0339-4783-8192-c0588ab31b7a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:18.534394 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6223b974-0339-4783-8192-c0588ab31b7a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:18.535126 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6223b974-0339-4783-8192-c0588ab31b7a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:18.535568 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6223b974-0339-4783-8192-c0588ab31b7a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:18.669748 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-6223b974-0339-4783-8192-c0588ab31b7a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:18.678629 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-6223b974-0339-4783-8192-c0588ab31b7a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:18.680161 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-6223b974-0339-4783-8192-c0588ab31b7a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:18.681321 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-6223b974-0339-4783-8192-c0588ab31b7a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1796 microversion: 2.20 time: 0.159147 Jun 30 10:04:18.681905 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 248/479] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:04:18 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1796 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:04:21.922030 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-13cb4e3f-6542-455a-b55a-d8243e507fa5 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:21.922535 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-13cb4e3f-6542-455a-b55a-d8243e507fa5 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 8e2cdb14-25e9-4273-9606-a2c458b4ebd2] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:21.925002 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_api:SELECT=34 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:04:21.930377 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-13cb4e3f-6542-455a-b55a-d8243e507fa5 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:21.930817 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-13cb4e3f-6542-455a-b55a-d8243e507fa5 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:21.931579 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-13cb4e3f-6542-455a-b55a-d8243e507fa5 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:21.932044 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-13cb4e3f-6542-455a-b55a-d8243e507fa5 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:22.057812 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.objects.instance [None req-13cb4e3f-6542-455a-b55a-d8243e507fa5 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lazy-loading 'services' on Instance uuid 8e2cdb14-25e9-4273-9606-a2c458b4ebd2 {{(pid=117847) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:04:22.175762 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-13cb4e3f-6542-455a-b55a-d8243e507fa5 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2/os-volume_attachments/612c455b-7ebb-4ff3-bc75-37a6779dd975" status: 202 len: 0 microversion: 2.1 time: 0.257498 Jun 30 10:04:22.176467 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 232/480] 10.222.0.16 () {58 vars in 1415 bytes} [Thu Jun 30 10:04:21 2022] DELETE /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2/os-volume_attachments/612c455b-7ebb-4ff3-bc75-37a6779dd975 => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:04:23.303203 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-502de07c-726c-4c0c-8b2c-fbc713b3d5f3 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:23.303680 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-502de07c-726c-4c0c-8b2c-fbc713b3d5f3 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 8e2cdb14-25e9-4273-9606-a2c458b4ebd2] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:23.310404 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-502de07c-726c-4c0c-8b2c-fbc713b3d5f3 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:23.310851 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-502de07c-726c-4c0c-8b2c-fbc713b3d5f3 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:23.311609 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-502de07c-726c-4c0c-8b2c-fbc713b3d5f3 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:23.312070 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-502de07c-726c-4c0c-8b2c-fbc713b3d5f3 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:23.337360 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-502de07c-726c-4c0c-8b2c-fbc713b3d5f3 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 8e2cdb14-25e9-4273-9606-a2c458b4ebd2] Going to try to terminate instance {{(pid=117846) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 10:04:23.424760 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-502de07c-726c-4c0c-8b2c-fbc713b3d5f3 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2" status: 204 len: 0 microversion: 2.1 time: 0.125111 Jun 30 10:04:23.425348 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 249/481] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 10:04:23 2022] DELETE /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 10:04:23.436104 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-2bfa204e-e598-40c7-8f6b-00c7369762b5 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:23.436794 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-2bfa204e-e598-40c7-8f6b-00c7369762b5 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 8e2cdb14-25e9-4273-9606-a2c458b4ebd2] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:23.444032 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2bfa204e-e598-40c7-8f6b-00c7369762b5 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:23.444478 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2bfa204e-e598-40c7-8f6b-00c7369762b5 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:23.445235 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2bfa204e-e598-40c7-8f6b-00c7369762b5 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:23.445668 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2bfa204e-e598-40c7-8f6b-00c7369762b5 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:23.584621 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-2bfa204e-e598-40c7-8f6b-00c7369762b5 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:23.593648 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-2bfa204e-e598-40c7-8f6b-00c7369762b5 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2" status: 200 len: 1514 microversion: 2.1 time: 0.163271 Jun 30 10:04:23.594233 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 233/482] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:23 2022] GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:24.613067 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-d1ff2180-d2f9-4a5f-85af-e72323b3fcf7 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:24.613937 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-d1ff2180-d2f9-4a5f-85af-e72323b3fcf7 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 8e2cdb14-25e9-4273-9606-a2c458b4ebd2] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:24.623417 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d1ff2180-d2f9-4a5f-85af-e72323b3fcf7 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:24.624097 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d1ff2180-d2f9-4a5f-85af-e72323b3fcf7 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:24.625191 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d1ff2180-d2f9-4a5f-85af-e72323b3fcf7 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:24.625766 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d1ff2180-d2f9-4a5f-85af-e72323b3fcf7 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:24.764410 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-d1ff2180-d2f9-4a5f-85af-e72323b3fcf7 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:24.776632 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-d1ff2180-d2f9-4a5f-85af-e72323b3fcf7 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2" status: 200 len: 1514 microversion: 2.1 time: 0.168713 Jun 30 10:04:24.777437 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 250/483] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:24 2022] GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:25.799729 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-1ea36687-9674-4e59-af0f-015cabf2823e tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:25.800754 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-1ea36687-9674-4e59-af0f-015cabf2823e tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 8e2cdb14-25e9-4273-9606-a2c458b4ebd2] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:25.807485 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1ea36687-9674-4e59-af0f-015cabf2823e tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:25.807940 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1ea36687-9674-4e59-af0f-015cabf2823e tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:25.808689 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1ea36687-9674-4e59-af0f-015cabf2823e tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:25.809113 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1ea36687-9674-4e59-af0f-015cabf2823e tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:25.811809 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=1 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:04:25.900358 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-1ea36687-9674-4e59-af0f-015cabf2823e tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:25.908212 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-1ea36687-9674-4e59-af0f-015cabf2823e tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2" status: 200 len: 1472 microversion: 2.1 time: 0.112597 Jun 30 10:04:25.908782 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 234/484] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:25 2022] GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2 => generated 1472 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:25.947515 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-b6cc1200-666d-4e2c-a00b-a9338ad52ad0 req-ce9dc5a7-a20d-4c49-a13a-e0d8576d8bb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e2cdb14-25e9-4273-9606-a2c458b4ebd2", "name": "network-vif-deleted", "tag": "64a7a6be-2b47-4c6f-9bc2-8e87a6042470"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:04:25.951282 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:04:25.957501 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-b6cc1200-666d-4e2c-a00b-a9338ad52ad0 req-ce9dc5a7-a20d-4c49-a13a-e0d8576d8bb2 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:25.957990 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-b6cc1200-666d-4e2c-a00b-a9338ad52ad0 req-ce9dc5a7-a20d-4c49-a13a-e0d8576d8bb2 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:25.969225 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-b6cc1200-666d-4e2c-a00b-a9338ad52ad0 req-ce9dc5a7-a20d-4c49-a13a-e0d8576d8bb2 service nova] Creating event network-vif-deleted:64a7a6be-2b47-4c6f-9bc2-8e87a6042470 for instance 8e2cdb14-25e9-4273-9606-a2c458b4ebd2 on hv-cinder-84330 Jun 30 10:04:25.974023 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-b6cc1200-666d-4e2c-a00b-a9338ad52ad0 req-ce9dc5a7-a20d-4c49-a13a-e0d8576d8bb2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030208 Jun 30 10:04:25.974653 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 251/485] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:04:26.929495 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-14e0b02e-c771-481a-88da-195d22531aa2 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:26.930464 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-14e0b02e-c771-481a-88da-195d22531aa2 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 8e2cdb14-25e9-4273-9606-a2c458b4ebd2] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:26.941777 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-14e0b02e-c771-481a-88da-195d22531aa2 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:26.942504 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-14e0b02e-c771-481a-88da-195d22531aa2 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:26.943728 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-14e0b02e-c771-481a-88da-195d22531aa2 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:26.944491 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-14e0b02e-c771-481a-88da-195d22531aa2 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:26.961355 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.wsgi [None req-14e0b02e-c771-481a-88da-195d22531aa2 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] HTTP exception thrown: Instance 8e2cdb14-25e9-4273-9606-a2c458b4ebd2 could not be found. Jun 30 10:04:26.962996 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-14e0b02e-c771-481a-88da-195d22531aa2 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Request method failure captured: Jun 30 10:04:26.962996 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: request: GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2 HTTP/1.1 Jun 30 10:04:26.962996 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept: application/json Jun 30 10:04:26.962996 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept-Encoding: identity Jun 30 10:04:26.962996 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Connection: close Jun 30 10:04:26.962996 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Length: 0 Jun 30 10:04:26.962996 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Type: application/json Jun 30 10:04:26.962996 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Host: 10.222.0.16 Jun 30 10:04:26.962996 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Openstack-System-Scope: None Jun 30 10:04:26.962996 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: User-Agent: python-urllib3/1.26.9 Jun 30 10:04:26.962996 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Auth-Token: gAAAAABivXS8dMpigLjmiZFhfRUMARC0-yNbGzXMq6HrmIfPWBekeX6oWWuOlYPLigV9Ygv9SzgEo1GO8g-eCT4QjYtuOH7uYjt0JIVG8on9AxS9FeZYJCdQd2f53RWvmXWpTcLy64J4CIRl2ZP8qJDQFSo9r0zMgM85Zd6aAlB97cZWEKRGEmw Jun 30 10:04:26.962996 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Id: None Jun 30 10:04:26.962996 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Name: None Jun 30 10:04:26.962996 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Identity-Status: Confirmed Jun 30 10:04:26.962996 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Is-Admin-Project: True Jun 30 10:04:26.962996 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Id: default Jun 30 10:04:26.962996 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Name: Default Jun 30 10:04:26.962996 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Id: 8de5ed099cad4e6aa38f12d16cfb9615 Jun 30 10:04:26.962996 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1527204311 Jun 30 10:04:26.962996 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Role: reader,member Jun 30 10:04:26.962996 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Roles: reader,member Jun 30 10:04:26.964524 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8de5ed099cad4e6aa38f12d16cfb9615"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8de5ed099cad4e6aa38f12d16cfb9615"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8de5ed099cad4e6aa38f12d16cfb9615"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8de5ed099cad4e6aa38f12d16cfb9615"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:04:26.964524 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant: tempest-VolumesSnapshotTestJSON-1527204311 Jun 30 10:04:26.964524 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Id: 8de5ed099cad4e6aa38f12d16cfb9615 Jun 30 10:04:26.964524 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1527204311 Jun 30 10:04:26.964524 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User: tempest-VolumesSnapshotTestJSON-1527204311-project Jun 30 10:04:26.964524 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Id: default Jun 30 10:04:26.964524 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Name: Default Jun 30 10:04:26.964524 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Id: 957f396e32bc48c0866a53122122bc7a Jun 30 10:04:26.964524 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Name: tempest-VolumesSnapshotTestJSON-1527204311-project Jun 30 10:04:26.964524 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: method: > Jun 30 10:04:26.964524 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: exception: Instance 8e2cdb14-25e9-4273-9606-a2c458b4ebd2 could not be found. Jun 30 10:04:26.964524 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: action_args: {'id': '8e2cdb14-25e9-4273-9606-a2c458b4ebd2'} Jun 30 10:04:26.965374 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:04:26.965374 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:04:26.965374 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:04:26.965374 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:04:26.965374 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:04:26.965374 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:04:26.965374 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:04:26.965374 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:04:26.965374 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:04:26.965374 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:04:26.965374 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e2cdb14-25e9-4273-9606-a2c458b4ebd2 could not be found. Jun 30 10:04:26.965374 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:04:26.965374 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:04:26.965374 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:04:26.965374 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:04:26.965374 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:04:26.965374 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:04:26.965374 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:04:26.965374 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:04:26.965374 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:04:26.966780 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:04:26.966780 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:04:26.966780 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:04:26.966780 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:04:26.966780 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:04:26.966780 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:04:26.966780 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:04:26.966780 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e2cdb14-25e9-4273-9606-a2c458b4ebd2 could not be found. Jun 30 10:04:26.966780 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:04:26.966780 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:04:26.966780 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:04:26.966780 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:04:26.966780 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:04:26.966780 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:04:26.966780 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:04:26.966780 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:04:26.966780 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e2cdb14-25e9-4273-9606-a2c458b4ebd2 could not be found. Jun 30 10:04:26.966780 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:04:26.968113 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-14e0b02e-c771-481a-88da-195d22531aa2 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Returning 404 to user: Instance 8e2cdb14-25e9-4273-9606-a2c458b4ebd2 could not be found. {{(pid=117847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:04:26.968113 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-14e0b02e-c771-481a-88da-195d22531aa2 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2" status: 404 len: 111 microversion: 2.1 time: 0.041271 Jun 30 10:04:26.968113 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 235/486] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:26 2022] GET /compute/v2.1/servers/8e2cdb14-25e9-4273-9606-a2c458b4ebd2 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:04:34.590087 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-7d3ceeb6-3b86-4d60-81ec-e52729e1f368 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:04:34.591099 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-7d3ceeb6-3b86-4d60-81ec-e52729e1f368 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:34.598135 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7d3ceeb6-3b86-4d60-81ec-e52729e1f368 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:34.598582 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7d3ceeb6-3b86-4d60-81ec-e52729e1f368 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:34.599349 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7d3ceeb6-3b86-4d60-81ec-e52729e1f368 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:34.599775 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7d3ceeb6-3b86-4d60-81ec-e52729e1f368 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:34.602455 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:04:34.681135 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-7d3ceeb6-3b86-4d60-81ec-e52729e1f368 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "POST /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be/action" status: 202 len: 0 microversion: 2.1 time: 0.095854 Jun 30 10:04:34.681798 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 252/487] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Jun 30 10:04:34 2022] POST /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:04:34.690503 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-22462374-8f09-4f32-98f0-fadd1c1c8a9b tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:34.691118 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-22462374-8f09-4f32-98f0-fadd1c1c8a9b tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:34.697912 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-22462374-8f09-4f32-98f0-fadd1c1c8a9b tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:34.698455 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-22462374-8f09-4f32-98f0-fadd1c1c8a9b tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:34.699345 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-22462374-8f09-4f32-98f0-fadd1c1c8a9b tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:34.699770 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-22462374-8f09-4f32-98f0-fadd1c1c8a9b tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:34.852968 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-22462374-8f09-4f32-98f0-fadd1c1c8a9b tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:34.865729 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-22462374-8f09-4f32-98f0-fadd1c1c8a9b tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1751 microversion: 2.1 time: 0.179181 Jun 30 10:04:34.866454 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 236/488] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:34 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1751 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:34.985385 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-d4b55b38-1027-46e3-827b-f5bb8521a6bc tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:34.986000 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-d4b55b38-1027-46e3-827b-f5bb8521a6bc tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 4223d53f-8e20-4343-9119-08cd7dfa6afe] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:34.993100 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d4b55b38-1027-46e3-827b-f5bb8521a6bc tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:34.993569 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d4b55b38-1027-46e3-827b-f5bb8521a6bc tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:34.994379 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d4b55b38-1027-46e3-827b-f5bb8521a6bc tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:34.994831 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d4b55b38-1027-46e3-827b-f5bb8521a6bc tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:35.021837 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-d4b55b38-1027-46e3-827b-f5bb8521a6bc tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe/ips" status: 200 len: 150 microversion: 2.1 time: 0.043150 Jun 30 10:04:35.022580 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 253/489] 10.222.0.16 () {58 vars in 1247 bytes} [Thu Jun 30 10:04:34 2022] GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:04:35.038748 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-161ad620-5828-4f5d-bcc7-20830fa72182 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a44a4a04-03d7-46ca-a520-0273af8373d4"}} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:04:35.040478 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-161ad620-5828-4f5d-bcc7-20830fa72182 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 4223d53f-8e20-4343-9119-08cd7dfa6afe] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:35.048439 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-161ad620-5828-4f5d-bcc7-20830fa72182 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:35.048877 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-161ad620-5828-4f5d-bcc7-20830fa72182 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:35.049628 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-161ad620-5828-4f5d-bcc7-20830fa72182 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:35.050027 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-161ad620-5828-4f5d-bcc7-20830fa72182 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:35.144658 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.wsgi [None req-161ad620-5828-4f5d-bcc7-20830fa72182 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] HTTP exception thrown: Invalid volume: volume a44a4a04-03d7-46ca-a520-0273af8373d4 is already attached to instances: 18a19a8d-e121-4f9d-8906-574d6ecce160 Jun 30 10:04:35.146736 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-161ad620-5828-4f5d-bcc7-20830fa72182 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Request method failure captured: Jun 30 10:04:35.146736 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: request: POST /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe/os-volume_attachments HTTP/1.1 Jun 30 10:04:35.146736 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept: application/json Jun 30 10:04:35.146736 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept-Encoding: identity Jun 30 10:04:35.146736 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Connection: close Jun 30 10:04:35.146736 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Length: 74 Jun 30 10:04:35.146736 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Type: application/json Jun 30 10:04:35.146736 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Host: 10.222.0.16 Jun 30 10:04:35.146736 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Openstack-System-Scope: None Jun 30 10:04:35.146736 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: User-Agent: python-urllib3/1.26.9 Jun 30 10:04:35.146736 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Auth-Token: gAAAAABivXRKWOm8okSqawQyEyFIlPPo5ED3-MkteEmCjIwaTuHRpOC0yz7t-S9pF6F_OHxcNFTgq2ZVvCBW8WpcDzubzrkM7lZXCNWSzcj1P8TCpyHfDpEvKKwyetYBPaKEvw3fBqcARKuB5F-oWIrvkHJpnEC8cyolAJOOfEpEG7HP2E8WCR8 Jun 30 10:04:35.146736 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Id: None Jun 30 10:04:35.146736 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Name: None Jun 30 10:04:35.146736 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Identity-Status: Confirmed Jun 30 10:04:35.146736 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Is-Admin-Project: True Jun 30 10:04:35.146736 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Id: default Jun 30 10:04:35.146736 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Name: Default Jun 30 10:04:35.146736 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Id: 2e55dd4580184f158efedbad5dc6e8fb Jun 30 10:04:35.146736 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Name: tempest-AttachVolumeNegativeTest-821277988 Jun 30 10:04:35.146736 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Role: reader,member Jun 30 10:04:35.146736 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Roles: reader,member Jun 30 10:04:35.148357 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:04:35.148357 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant: tempest-AttachVolumeNegativeTest-821277988 Jun 30 10:04:35.148357 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Id: 2e55dd4580184f158efedbad5dc6e8fb Jun 30 10:04:35.148357 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-821277988 Jun 30 10:04:35.148357 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User: tempest-AttachVolumeNegativeTest-821277988-project Jun 30 10:04:35.148357 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Id: default Jun 30 10:04:35.148357 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Name: Default Jun 30 10:04:35.148357 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Id: 4e9ad2c4909c49a6b3df8ece333e70b5 Jun 30 10:04:35.148357 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Name: tempest-AttachVolumeNegativeTest-821277988-project Jun 30 10:04:35.148357 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Jun 30 10:04:35.148357 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: {"volumeAttachment": {"volumeId": "a44a4a04-03d7-46ca-a520-0273af8373d4"}} Jun 30 10:04:35.148357 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: method: > Jun 30 10:04:35.149162 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: exception: Invalid volume: volume a44a4a04-03d7-46ca-a520-0273af8373d4 is already attached to instances: 18a19a8d-e121-4f9d-8906-574d6ecce160 Jun 30 10:04:35.149162 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: action_args: {'server_id': '4223d53f-8e20-4343-9119-08cd7dfa6afe', 'body': {'volumeAttachment': {'volumeId': 'a44a4a04-03d7-46ca-a520-0273af8373d4'}}} Jun 30 10:04:35.149162 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:04:35.149162 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:04:35.149162 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 30 10:04:35.149162 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 30 10:04:35.149162 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 30 10:04:35.149162 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 30 10:04:35.149162 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 30 10:04:35.149162 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 30 10:04:35.149162 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 30 10:04:35.149162 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 30 10:04:35.149162 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 30 10:04:35.149162 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 30 10:04:35.149162 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a44a4a04-03d7-46ca-a520-0273af8373d4 is already attached to instances: 18a19a8d-e121-4f9d-8906-574d6ecce160 Jun 30 10:04:35.149162 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:04:35.149162 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:04:35.149162 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:04:35.149162 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:04:35.150442 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:04:35.150442 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:04:35.150442 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:04:35.150442 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:04:35.150442 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:04:35.150442 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:04:35.150442 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 10:04:35.150442 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 10:04:35.150442 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 10:04:35.150442 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 10:04:35.150442 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 10:04:35.150442 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 10:04:35.150442 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 30 10:04:35.150442 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 30 10:04:35.150442 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a44a4a04-03d7-46ca-a520-0273af8373d4 is already attached to instances: 18a19a8d-e121-4f9d-8906-574d6ecce160 Jun 30 10:04:35.150442 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:04:35.150442 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:04:35.150442 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:04:35.150442 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:04:35.150442 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:04:35.151624 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:04:35.151624 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:04:35.151624 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:04:35.151624 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a44a4a04-03d7-46ca-a520-0273af8373d4 is already attached to instances: 18a19a8d-e121-4f9d-8906-574d6ecce160 Jun 30 10:04:35.151624 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:04:35.151624 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-161ad620-5828-4f5d-bcc7-20830fa72182 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Returning 400 to user: Invalid volume: volume a44a4a04-03d7-46ca-a520-0273af8373d4 is already attached to instances: 18a19a8d-e121-4f9d-8906-574d6ecce160 {{(pid=117847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:04:35.151624 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-161ad620-5828-4f5d-bcc7-20830fa72182 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "POST /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.116837 Jun 30 10:04:35.151624 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 237/490] 10.222.0.16 () {60 vars in 1322 bytes} [Thu Jun 30 10:04:35 2022] POST /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe/os-volume_attachments => generated 174 bytes in 119 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 30 10:04:35.158774 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-d9aaaa2d-47c4-44f1-8ebe-ae3e629f60e1 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:35.159398 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-d9aaaa2d-47c4-44f1-8ebe-ae3e629f60e1 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 4223d53f-8e20-4343-9119-08cd7dfa6afe] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:35.165519 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d9aaaa2d-47c4-44f1-8ebe-ae3e629f60e1 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:35.165951 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d9aaaa2d-47c4-44f1-8ebe-ae3e629f60e1 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:35.166687 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d9aaaa2d-47c4-44f1-8ebe-ae3e629f60e1 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:35.167106 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d9aaaa2d-47c4-44f1-8ebe-ae3e629f60e1 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:35.191551 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-d9aaaa2d-47c4-44f1-8ebe-ae3e629f60e1 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 4223d53f-8e20-4343-9119-08cd7dfa6afe] Going to try to terminate instance {{(pid=117846) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 10:04:35.268564 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-d9aaaa2d-47c4-44f1-8ebe-ae3e629f60e1 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe" status: 204 len: 0 microversion: 2.1 time: 0.113333 Jun 30 10:04:35.269410 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 254/491] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 10:04:35 2022] DELETE /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 30 10:04:35.279199 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-19939bc5-5fa3-4b26-a2d0-6fbfbfe32495 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:35.280356 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-19939bc5-5fa3-4b26-a2d0-6fbfbfe32495 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 4223d53f-8e20-4343-9119-08cd7dfa6afe] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:35.287443 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-19939bc5-5fa3-4b26-a2d0-6fbfbfe32495 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:35.287896 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-19939bc5-5fa3-4b26-a2d0-6fbfbfe32495 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:35.288679 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-19939bc5-5fa3-4b26-a2d0-6fbfbfe32495 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:35.289107 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-19939bc5-5fa3-4b26-a2d0-6fbfbfe32495 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:35.427920 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-19939bc5-5fa3-4b26-a2d0-6fbfbfe32495 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:35.438780 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-19939bc5-5fa3-4b26-a2d0-6fbfbfe32495 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe" status: 200 len: 1681 microversion: 2.1 time: 0.164838 Jun 30 10:04:35.439338 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 238/492] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:35 2022] GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:35.869848 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-4513aef0-01fe-4993-bee2-a0fc137d6ef4 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1937682978", "imageRef": "c9dccba6-70d7-4aa8-9b8f-9c88ef1af443", "flavorRef": "452", "networks": [{"uuid": "105f04e0-7c25-4899-bcd0-828f74ca8a18"}]}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:04:35.886206 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-394bda23-1875-4099-8575-8f39adda0eea tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:35.886924 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-394bda23-1875-4099-8575-8f39adda0eea tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:35.894746 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-394bda23-1875-4099-8575-8f39adda0eea tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:35.895192 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-394bda23-1875-4099-8575-8f39adda0eea tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:35.896015 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-394bda23-1875-4099-8575-8f39adda0eea tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:35.896411 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-394bda23-1875-4099-8575-8f39adda0eea tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:35.924939 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.network.neutron [None req-4513aef0-01fe-4993-bee2-a0fc137d6ef4 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] validate_networks() for [('105f04e0-7c25-4899-bcd0-828f74ca8a18', None, None, None, None, None)] {{(pid=117846) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 10:04:36.126724 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-394bda23-1875-4099-8575-8f39adda0eea tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:36.135224 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-394bda23-1875-4099-8575-8f39adda0eea tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1751 microversion: 2.1 time: 0.253181 Jun 30 10:04:36.135790 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 239/493] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:35 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1751 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:36.348841 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-4513aef0-01fe-4993-bee2-a0fc137d6ef4 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Flavor limits 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 10:04:36.349426 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-4513aef0-01fe-4993-bee2-a0fc137d6ef4 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Image limits 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 10:04:36.350060 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-4513aef0-01fe-4993-bee2-a0fc137d6ef4 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Flavor pref 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 10:04:36.350527 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-4513aef0-01fe-4993-bee2-a0fc137d6ef4 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Image pref 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 10:04:36.351050 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-4513aef0-01fe-4993-bee2-a0fc137d6ef4 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 10:04:36.365527 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4513aef0-01fe-4993-bee2-a0fc137d6ef4 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:36.366151 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4513aef0-01fe-4993-bee2-a0fc137d6ef4 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:36.367314 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4513aef0-01fe-4993-bee2-a0fc137d6ef4 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:36.367846 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4513aef0-01fe-4993-bee2-a0fc137d6ef4 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:36.386776 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-4513aef0-01fe-4993-bee2-a0fc137d6ef4 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Getting quotas for project 8de5ed099cad4e6aa38f12d16cfb9615. Resources: {'ram', 'instances', 'cores'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:04:36.390937 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-4513aef0-01fe-4993-bee2-a0fc137d6ef4 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Getting quotas for user 957f396e32bc48c0866a53122122bc7a and project 8de5ed099cad4e6aa38f12d16cfb9615. Resources: {'ram', 'instances', 'cores'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:04:36.402701 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-4513aef0-01fe-4993-bee2-a0fc137d6ef4 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Going to run 1 instances... {{(pid=117846) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 10:04:36.405147 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-4513aef0-01fe-4993-bee2-a0fc137d6ef4 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 2270d4c1-54d0-468c-acc2-cc2dbc933058] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9dccba6-70d7-4aa8-9b8f-9c88ef1af443',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117846) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 10:04:36.451969 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-4513aef0-01fe-4993-bee2-a0fc137d6ef4 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.586335 Jun 30 10:04:36.452621 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 255/494] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jun 30 10:04:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 10:04:36.463317 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-f55f1845-e88c-4c84-9487-03d0726d1319 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:36.464087 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-a0dc17c5-ed55-4dd1-9180-037de4fdc2cb tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:36.464221 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-f55f1845-e88c-4c84-9487-03d0726d1319 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 2270d4c1-54d0-468c-acc2-cc2dbc933058] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:36.464691 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-a0dc17c5-ed55-4dd1-9180-037de4fdc2cb tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 4223d53f-8e20-4343-9119-08cd7dfa6afe] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:36.471651 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a0dc17c5-ed55-4dd1-9180-037de4fdc2cb tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:36.471986 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a0dc17c5-ed55-4dd1-9180-037de4fdc2cb tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:36.472683 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a0dc17c5-ed55-4dd1-9180-037de4fdc2cb tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:36.473091 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a0dc17c5-ed55-4dd1-9180-037de4fdc2cb tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:36.539221 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-f55f1845-e88c-4c84-9487-03d0726d1319 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:36.546683 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-f55f1845-e88c-4c84-9487-03d0726d1319 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/2270d4c1-54d0-468c-acc2-cc2dbc933058" status: 200 len: 1219 microversion: 2.1 time: 0.087863 Jun 30 10:04:36.547348 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 240/495] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:36 2022] GET /compute/v2.1/servers/2270d4c1-54d0-468c-acc2-cc2dbc933058 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:36.623692 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-a0dc17c5-ed55-4dd1-9180-037de4fdc2cb tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:36.631481 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-a0dc17c5-ed55-4dd1-9180-037de4fdc2cb tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe" status: 200 len: 1681 microversion: 2.1 time: 0.171244 Jun 30 10:04:36.632079 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 256/496] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:36 2022] GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:37.156939 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-25a12e82-d4d4-4539-8ca0-dd9f74f362da tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:37.158006 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-25a12e82-d4d4-4539-8ca0-dd9f74f362da tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:37.167909 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-25a12e82-d4d4-4539-8ca0-dd9f74f362da tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:37.168359 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-25a12e82-d4d4-4539-8ca0-dd9f74f362da tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:37.169128 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-25a12e82-d4d4-4539-8ca0-dd9f74f362da tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:37.169780 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-25a12e82-d4d4-4539-8ca0-dd9f74f362da tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:37.567088 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-29082ff3-1c7b-4acd-9fce-9eab79ca3482 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:37.567670 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-29082ff3-1c7b-4acd-9fce-9eab79ca3482 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 2270d4c1-54d0-468c-acc2-cc2dbc933058] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:37.577377 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-29082ff3-1c7b-4acd-9fce-9eab79ca3482 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:37.578118 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-29082ff3-1c7b-4acd-9fce-9eab79ca3482 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:37.579364 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-29082ff3-1c7b-4acd-9fce-9eab79ca3482 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:37.580104 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-29082ff3-1c7b-4acd-9fce-9eab79ca3482 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:37.765731 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-29082ff3-1c7b-4acd-9fce-9eab79ca3482 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:37.776877 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-29082ff3-1c7b-4acd-9fce-9eab79ca3482 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/2270d4c1-54d0-468c-acc2-cc2dbc933058" status: 200 len: 1271 microversion: 2.1 time: 0.216216 Jun 30 10:04:37.777490 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 257/497] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:37 2022] GET /compute/v2.1/servers/2270d4c1-54d0-468c-acc2-cc2dbc933058 => generated 1271 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:37.782584 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-2c398516-63bb-47c9-b3bd-1db0a80b1ee6 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:37.783349 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-2c398516-63bb-47c9-b3bd-1db0a80b1ee6 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 4223d53f-8e20-4343-9119-08cd7dfa6afe] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:37.790106 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2c398516-63bb-47c9-b3bd-1db0a80b1ee6 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:37.790551 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2c398516-63bb-47c9-b3bd-1db0a80b1ee6 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:37.791327 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2c398516-63bb-47c9-b3bd-1db0a80b1ee6 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:37.791819 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2c398516-63bb-47c9-b3bd-1db0a80b1ee6 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:37.957312 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-25a12e82-d4d4-4539-8ca0-dd9f74f362da tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:37.965519 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-25a12e82-d4d4-4539-8ca0-dd9f74f362da tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1751 microversion: 2.1 time: 0.816497 Jun 30 10:04:37.966119 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 241/498] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:37 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1751 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:04:38.287803 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-2c398516-63bb-47c9-b3bd-1db0a80b1ee6 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:38.298147 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-2c398516-63bb-47c9-b3bd-1db0a80b1ee6 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe" status: 200 len: 1681 microversion: 2.1 time: 0.519605 Jun 30 10:04:38.298718 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 258/499] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:37 2022] GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe => generated 1681 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:38.809529 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-81f5c941-aa29-4c6c-9c25-a1ac47f7d037 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:38.810206 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-81f5c941-aa29-4c6c-9c25-a1ac47f7d037 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 2270d4c1-54d0-468c-acc2-cc2dbc933058] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:38.818182 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-81f5c941-aa29-4c6c-9c25-a1ac47f7d037 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:38.818942 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-81f5c941-aa29-4c6c-9c25-a1ac47f7d037 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:38.819984 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-81f5c941-aa29-4c6c-9c25-a1ac47f7d037 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:38.820414 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-81f5c941-aa29-4c6c-9c25-a1ac47f7d037 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:38.895509 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-81f5c941-aa29-4c6c-9c25-a1ac47f7d037 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:38.903943 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-81f5c941-aa29-4c6c-9c25-a1ac47f7d037 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/2270d4c1-54d0-468c-acc2-cc2dbc933058" status: 200 len: 1277 microversion: 2.1 time: 0.098763 Jun 30 10:04:38.904535 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 242/500] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:38 2022] GET /compute/v2.1/servers/2270d4c1-54d0-468c-acc2-cc2dbc933058 => generated 1277 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:38.983021 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-316b7fab-20a0-4216-b720-054760a2d595 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:38.983960 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-316b7fab-20a0-4216-b720-054760a2d595 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:38.990959 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-316b7fab-20a0-4216-b720-054760a2d595 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:38.991399 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-316b7fab-20a0-4216-b720-054760a2d595 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:38.992188 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-316b7fab-20a0-4216-b720-054760a2d595 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:38.992614 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-316b7fab-20a0-4216-b720-054760a2d595 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:39.314874 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-2a92561c-08b0-4039-8a22-3004b09f767b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:39.315777 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-2a92561c-08b0-4039-8a22-3004b09f767b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 4223d53f-8e20-4343-9119-08cd7dfa6afe] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:39.322558 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2a92561c-08b0-4039-8a22-3004b09f767b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:39.323010 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2a92561c-08b0-4039-8a22-3004b09f767b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:39.323849 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2a92561c-08b0-4039-8a22-3004b09f767b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:39.324306 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2a92561c-08b0-4039-8a22-3004b09f767b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:39.421149 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-2a92561c-08b0-4039-8a22-3004b09f767b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:39.429210 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-2a92561c-08b0-4039-8a22-3004b09f767b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe" status: 200 len: 1614 microversion: 2.1 time: 0.118203 Jun 30 10:04:39.429732 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 243/501] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:39 2022] GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe => generated 1614 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:39.434888 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-a4274432-0767-4605-9150-6d36bc12ae2a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4cdac408-153b-4727-b5e0-3308a5cbe964"}} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:04:39.436743 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-a4274432-0767-4605-9150-6d36bc12ae2a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:39.444546 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a4274432-0767-4605-9150-6d36bc12ae2a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:39.445067 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a4274432-0767-4605-9150-6d36bc12ae2a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:39.445924 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a4274432-0767-4605-9150-6d36bc12ae2a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:39.446421 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a4274432-0767-4605-9150-6d36bc12ae2a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:39.587896 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-316b7fab-20a0-4216-b720-054760a2d595 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:39.597575 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-316b7fab-20a0-4216-b720-054760a2d595 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1756 microversion: 2.1 time: 0.618556 Jun 30 10:04:39.598827 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 259/502] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:38 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1756 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:39.716139 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-a4274432-0767-4605-9150-6d36bc12ae2a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "POST /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284664 Jun 30 10:04:39.717548 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 244/503] 10.222.0.16 () {60 vars in 1322 bytes} [Thu Jun 30 10:04:39 2022] POST /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:04:39.823491 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-2f76fd8a-868b-4699-9ef2-480398d8bc57 req-f5af6825-1762-4fad-be3e-f737b6679dd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4223d53f-8e20-4343-9119-08cd7dfa6afe", "name": "network-vif-deleted", "tag": "709dddb2-4ee5-4391-9682-278c94b807de"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:04:39.844793 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-2f76fd8a-868b-4699-9ef2-480398d8bc57 req-f5af6825-1762-4fad-be3e-f737b6679dd6 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:39.857725 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-2f76fd8a-868b-4699-9ef2-480398d8bc57 req-f5af6825-1762-4fad-be3e-f737b6679dd6 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:39.879558 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-2f76fd8a-868b-4699-9ef2-480398d8bc57 req-f5af6825-1762-4fad-be3e-f737b6679dd6 service nova] Creating event network-vif-deleted:709dddb2-4ee5-4391-9682-278c94b807de for instance 4223d53f-8e20-4343-9119-08cd7dfa6afe on hv-cinder-84330 Jun 30 10:04:39.884762 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-2f76fd8a-868b-4699-9ef2-480398d8bc57 req-f5af6825-1762-4fad-be3e-f737b6679dd6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068440 Jun 30 10:04:39.885914 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 260/504] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:04:39.922169 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-3b9ea52e-45fa-433a-ac93-6c1104ac8739 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:39.922944 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-3b9ea52e-45fa-433a-ac93-6c1104ac8739 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 2270d4c1-54d0-468c-acc2-cc2dbc933058] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:39.931019 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3b9ea52e-45fa-433a-ac93-6c1104ac8739 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:39.931941 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3b9ea52e-45fa-433a-ac93-6c1104ac8739 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:39.932930 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3b9ea52e-45fa-433a-ac93-6c1104ac8739 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:39.933588 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3b9ea52e-45fa-433a-ac93-6c1104ac8739 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:40.168168 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-3b9ea52e-45fa-433a-ac93-6c1104ac8739 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:40.175840 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-3b9ea52e-45fa-433a-ac93-6c1104ac8739 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/2270d4c1-54d0-468c-acc2-cc2dbc933058" status: 200 len: 1319 microversion: 2.1 time: 0.258053 Jun 30 10:04:40.176436 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 245/505] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:39 2022] GET /compute/v2.1/servers/2270d4c1-54d0-468c-acc2-cc2dbc933058 => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:40.448646 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-78bede06-c11b-4eec-ab59-863b7a12da60 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:40.449858 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-78bede06-c11b-4eec-ab59-863b7a12da60 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 4223d53f-8e20-4343-9119-08cd7dfa6afe] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:40.456610 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-78bede06-c11b-4eec-ab59-863b7a12da60 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:40.457323 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-78bede06-c11b-4eec-ab59-863b7a12da60 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:40.458301 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-78bede06-c11b-4eec-ab59-863b7a12da60 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:40.458959 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-78bede06-c11b-4eec-ab59-863b7a12da60 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:40.475390 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-78bede06-c11b-4eec-ab59-863b7a12da60 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] HTTP exception thrown: Instance 4223d53f-8e20-4343-9119-08cd7dfa6afe could not be found. Jun 30 10:04:40.477060 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-78bede06-c11b-4eec-ab59-863b7a12da60 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Request method failure captured: Jun 30 10:04:40.477060 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: request: GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe HTTP/1.1 Jun 30 10:04:40.477060 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept: application/json Jun 30 10:04:40.477060 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jun 30 10:04:40.477060 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Connection: close Jun 30 10:04:40.477060 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jun 30 10:04:40.477060 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jun 30 10:04:40.477060 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Host: 10.222.0.16 Jun 30 10:04:40.477060 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jun 30 10:04:40.477060 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jun 30 10:04:40.477060 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABivXRKWOm8okSqawQyEyFIlPPo5ED3-MkteEmCjIwaTuHRpOC0yz7t-S9pF6F_OHxcNFTgq2ZVvCBW8WpcDzubzrkM7lZXCNWSzcj1P8TCpyHfDpEvKKwyetYBPaKEvw3fBqcARKuB5F-oWIrvkHJpnEC8cyolAJOOfEpEG7HP2E8WCR8 Jun 30 10:04:40.477060 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jun 30 10:04:40.477060 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jun 30 10:04:40.477060 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jun 30 10:04:40.477060 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jun 30 10:04:40.477060 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jun 30 10:04:40.477060 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jun 30 10:04:40.477060 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Id: 2e55dd4580184f158efedbad5dc6e8fb Jun 30 10:04:40.477060 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-AttachVolumeNegativeTest-821277988 Jun 30 10:04:40.477060 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Role: reader,member Jun 30 10:04:40.477060 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Roles: reader,member Jun 30 10:04:40.478641 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:04:40.478641 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-AttachVolumeNegativeTest-821277988 Jun 30 10:04:40.478641 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 2e55dd4580184f158efedbad5dc6e8fb Jun 30 10:04:40.478641 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-821277988 Jun 30 10:04:40.478641 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User: tempest-AttachVolumeNegativeTest-821277988-project Jun 30 10:04:40.478641 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jun 30 10:04:40.478641 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jun 30 10:04:40.478641 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Id: 4e9ad2c4909c49a6b3df8ece333e70b5 Jun 30 10:04:40.478641 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-AttachVolumeNegativeTest-821277988-project Jun 30 10:04:40.478641 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: method: > Jun 30 10:04:40.478641 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: exception: Instance 4223d53f-8e20-4343-9119-08cd7dfa6afe could not be found. Jun 30 10:04:40.478641 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: action_args: {'id': '4223d53f-8e20-4343-9119-08cd7dfa6afe'} Jun 30 10:04:40.479364 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:04:40.479364 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:04:40.479364 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:04:40.479364 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:04:40.479364 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:04:40.479364 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:04:40.479364 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:04:40.479364 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:04:40.479364 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:04:40.479364 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:04:40.479364 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4223d53f-8e20-4343-9119-08cd7dfa6afe could not be found. Jun 30 10:04:40.479364 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:04:40.479364 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:04:40.479364 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:04:40.479364 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:04:40.479364 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:04:40.479364 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:04:40.479364 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:04:40.479364 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:04:40.479364 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:04:40.481017 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:04:40.481017 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:04:40.481017 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:04:40.481017 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:04:40.481017 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:04:40.481017 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:04:40.481017 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:04:40.481017 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4223d53f-8e20-4343-9119-08cd7dfa6afe could not be found. Jun 30 10:04:40.481017 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:04:40.481017 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:04:40.481017 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:04:40.481017 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:04:40.481017 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:04:40.481017 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:04:40.481017 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:04:40.481017 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:04:40.481017 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4223d53f-8e20-4343-9119-08cd7dfa6afe could not be found. Jun 30 10:04:40.481017 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:04:40.483383 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-78bede06-c11b-4eec-ab59-863b7a12da60 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Returning 404 to user: Instance 4223d53f-8e20-4343-9119-08cd7dfa6afe could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:04:40.484293 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-78bede06-c11b-4eec-ab59-863b7a12da60 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe" status: 404 len: 111 microversion: 2.1 time: 0.040592 Jun 30 10:04:40.493296 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-a5eb22d1-65c8-40ba-8dbd-5fce7d6a528c tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '.version_select at 0x7fc22048c160>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:40.497626 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 261/506] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:40 2022] GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:04:40.516873 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-a5eb22d1-65c8-40ba-8dbd-5fce7d6a528c tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1088680422" status: 202 len: 0 microversion: 2.1 time: 0.027200 Jun 30 10:04:40.522289 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 246/507] 10.222.0.16 () {58 vars in 1220 bytes} [Thu Jun 30 10:04:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1088680422 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:04:40.615390 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-c22e304a-44d9-4fb0-b799-02692a8a6369 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:40.616186 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-c22e304a-44d9-4fb0-b799-02692a8a6369 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:40.627991 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c22e304a-44d9-4fb0-b799-02692a8a6369 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:40.631170 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c22e304a-44d9-4fb0-b799-02692a8a6369 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:40.632369 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c22e304a-44d9-4fb0-b799-02692a8a6369 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:40.633843 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c22e304a-44d9-4fb0-b799-02692a8a6369 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:41.004842 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-c22e304a-44d9-4fb0-b799-02692a8a6369 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:41.013431 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-c22e304a-44d9-4fb0-b799-02692a8a6369 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1756 microversion: 2.1 time: 0.402388 Jun 30 10:04:41.014679 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 262/508] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:40 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1756 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:41.193364 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-3a2d2539-d20f-4b9e-9fe7-dc76fa2eb1f0 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:41.194608 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-3a2d2539-d20f-4b9e-9fe7-dc76fa2eb1f0 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 2270d4c1-54d0-468c-acc2-cc2dbc933058] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:41.204342 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3a2d2539-d20f-4b9e-9fe7-dc76fa2eb1f0 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:41.205075 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3a2d2539-d20f-4b9e-9fe7-dc76fa2eb1f0 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:41.206022 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3a2d2539-d20f-4b9e-9fe7-dc76fa2eb1f0 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:41.206793 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3a2d2539-d20f-4b9e-9fe7-dc76fa2eb1f0 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:41.404324 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-280aef71-c195-43ca-985a-c9cf3e75a36f tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:41.404815 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-280aef71-c195-43ca-985a-c9cf3e75a36f tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 18a19a8d-e121-4f9d-8906-574d6ecce160] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:41.410926 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-280aef71-c195-43ca-985a-c9cf3e75a36f tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:41.411358 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-280aef71-c195-43ca-985a-c9cf3e75a36f tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:41.412338 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-280aef71-c195-43ca-985a-c9cf3e75a36f tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:41.412765 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-280aef71-c195-43ca-985a-c9cf3e75a36f tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:41.429802 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-3a2d2539-d20f-4b9e-9fe7-dc76fa2eb1f0 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:41.438049 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-3a2d2539-d20f-4b9e-9fe7-dc76fa2eb1f0 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/2270d4c1-54d0-468c-acc2-cc2dbc933058" status: 200 len: 1319 microversion: 2.1 time: 0.249285 Jun 30 10:04:41.448347 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 247/509] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:41 2022] GET /compute/v2.1/servers/2270d4c1-54d0-468c-acc2-cc2dbc933058 => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:41.545487 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.objects.instance [None req-280aef71-c195-43ca-985a-c9cf3e75a36f tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lazy-loading 'services' on Instance uuid 18a19a8d-e121-4f9d-8906-574d6ecce160 {{(pid=117846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:04:41.664385 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-280aef71-c195-43ca-985a-c9cf3e75a36f tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "DELETE /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160/os-volume_attachments/a44a4a04-03d7-46ca-a520-0273af8373d4" status: 202 len: 0 microversion: 2.1 time: 0.264696 Jun 30 10:04:41.665124 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 263/510] 10.222.0.16 () {58 vars in 1415 bytes} [Thu Jun 30 10:04:41 2022] DELETE /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160/os-volume_attachments/a44a4a04-03d7-46ca-a520-0273af8373d4 => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 30 10:04:41.674476 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-5c5e4513-4e99-4173-8267-9bd1b71f1123 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:41.675411 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-5c5e4513-4e99-4173-8267-9bd1b71f1123 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 18a19a8d-e121-4f9d-8906-574d6ecce160] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:41.682062 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-5c5e4513-4e99-4173-8267-9bd1b71f1123 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:41.682494 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-5c5e4513-4e99-4173-8267-9bd1b71f1123 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:41.683269 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-5c5e4513-4e99-4173-8267-9bd1b71f1123 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:41.683680 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-5c5e4513-4e99-4173-8267-9bd1b71f1123 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:41.714523 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-5c5e4513-4e99-4173-8267-9bd1b71f1123 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044674 Jun 30 10:04:41.715065 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 248/511] 10.222.0.16 () {58 vars in 1301 bytes} [Thu Jun 30 10:04:41 2022] GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:04:41.924048 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-fa392d20-b2dc-435f-8987-4169fd5c80be req-e02e68ac-6ced-4818-b768-8aee48ae7056 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2270d4c1-54d0-468c-acc2-cc2dbc933058", "tag": "703ecae9-4d65-4a21-99c8-e614d4240eda"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:04:41.933256 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-fa392d20-b2dc-435f-8987-4169fd5c80be req-e02e68ac-6ced-4818-b768-8aee48ae7056 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:41.933695 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-fa392d20-b2dc-435f-8987-4169fd5c80be req-e02e68ac-6ced-4818-b768-8aee48ae7056 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:41.944778 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-fa392d20-b2dc-435f-8987-4169fd5c80be req-e02e68ac-6ced-4818-b768-8aee48ae7056 service nova] Creating event network-changed:703ecae9-4d65-4a21-99c8-e614d4240eda for instance 2270d4c1-54d0-468c-acc2-cc2dbc933058 on hv-cinder-84330 Jun 30 10:04:41.949646 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-fa392d20-b2dc-435f-8987-4169fd5c80be req-e02e68ac-6ced-4818-b768-8aee48ae7056 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029704 Jun 30 10:04:41.950243 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 264/512] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:04:42.035092 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-8ccb7259-01fa-47dc-a14d-9006fcf125dc tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:42.036323 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-8ccb7259-01fa-47dc-a14d-9006fcf125dc tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:42.046086 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8ccb7259-01fa-47dc-a14d-9006fcf125dc tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:42.046526 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8ccb7259-01fa-47dc-a14d-9006fcf125dc tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:42.047275 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8ccb7259-01fa-47dc-a14d-9006fcf125dc tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:42.047704 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8ccb7259-01fa-47dc-a14d-9006fcf125dc tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:42.202281 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-8ccb7259-01fa-47dc-a14d-9006fcf125dc tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:42.211111 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-8ccb7259-01fa-47dc-a14d-9006fcf125dc tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1756 microversion: 2.1 time: 0.182266 Jun 30 10:04:42.211689 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 249/513] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:42 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:42.458236 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-12e47ddb-7fda-4cca-aba5-325fa2d4028f tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:42.459205 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-12e47ddb-7fda-4cca-aba5-325fa2d4028f tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 2270d4c1-54d0-468c-acc2-cc2dbc933058] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:42.471805 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-12e47ddb-7fda-4cca-aba5-325fa2d4028f tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:42.472424 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-12e47ddb-7fda-4cca-aba5-325fa2d4028f tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:42.473298 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-12e47ddb-7fda-4cca-aba5-325fa2d4028f tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:42.473789 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-12e47ddb-7fda-4cca-aba5-325fa2d4028f tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:42.678671 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-12e47ddb-7fda-4cca-aba5-325fa2d4028f tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:42.686842 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-12e47ddb-7fda-4cca-aba5-325fa2d4028f tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/2270d4c1-54d0-468c-acc2-cc2dbc933058" status: 200 len: 1319 microversion: 2.1 time: 0.235451 Jun 30 10:04:42.687430 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 265/514] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:42 2022] GET /compute/v2.1/servers/2270d4c1-54d0-468c-acc2-cc2dbc933058 => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:42.727241 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-d9e1e48e-6fa0-4432-9063-094f9b7a34bb tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:42.728291 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-d9e1e48e-6fa0-4432-9063-094f9b7a34bb tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 18a19a8d-e121-4f9d-8906-574d6ecce160] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:42.734938 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d9e1e48e-6fa0-4432-9063-094f9b7a34bb tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:42.735382 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d9e1e48e-6fa0-4432-9063-094f9b7a34bb tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:42.736177 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d9e1e48e-6fa0-4432-9063-094f9b7a34bb tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:42.736604 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d9e1e48e-6fa0-4432-9063-094f9b7a34bb tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:42.766562 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-d9e1e48e-6fa0-4432-9063-094f9b7a34bb tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043507 Jun 30 10:04:42.767122 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 250/515] 10.222.0.16 () {58 vars in 1301 bytes} [Thu Jun 30 10:04:42 2022] GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:04:43.232718 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f045f7dc-28c2-49e4-a36d-d56b7fd3b4c1 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:43.233238 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f045f7dc-28c2-49e4-a36d-d56b7fd3b4c1 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:43.239697 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f045f7dc-28c2-49e4-a36d-d56b7fd3b4c1 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:43.240139 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f045f7dc-28c2-49e4-a36d-d56b7fd3b4c1 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:43.240915 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f045f7dc-28c2-49e4-a36d-d56b7fd3b4c1 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:43.241337 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f045f7dc-28c2-49e4-a36d-d56b7fd3b4c1 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:43.397339 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f045f7dc-28c2-49e4-a36d-d56b7fd3b4c1 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:43.405655 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f045f7dc-28c2-49e4-a36d-d56b7fd3b4c1 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1756 microversion: 2.1 time: 0.179717 Jun 30 10:04:43.406208 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 266/516] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:43 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:43.707567 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-3c75c256-4370-4934-a131-28e28fbe5939 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:43.708715 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-3c75c256-4370-4934-a131-28e28fbe5939 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 2270d4c1-54d0-468c-acc2-cc2dbc933058] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:43.718893 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3c75c256-4370-4934-a131-28e28fbe5939 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:43.719363 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3c75c256-4370-4934-a131-28e28fbe5939 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:43.720151 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3c75c256-4370-4934-a131-28e28fbe5939 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:43.720572 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3c75c256-4370-4934-a131-28e28fbe5939 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:43.781396 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-efce7134-1338-44b8-a68d-2aeda333a8d4 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:43.782440 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-efce7134-1338-44b8-a68d-2aeda333a8d4 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 18a19a8d-e121-4f9d-8906-574d6ecce160] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:43.789255 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-efce7134-1338-44b8-a68d-2aeda333a8d4 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:43.789698 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-efce7134-1338-44b8-a68d-2aeda333a8d4 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:43.790481 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-efce7134-1338-44b8-a68d-2aeda333a8d4 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:43.791027 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-efce7134-1338-44b8-a68d-2aeda333a8d4 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:43.824978 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-efce7134-1338-44b8-a68d-2aeda333a8d4 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049697 Jun 30 10:04:43.825553 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 267/517] 10.222.0.16 () {58 vars in 1301 bytes} [Thu Jun 30 10:04:43 2022] GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:04:43.863040 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-3c75c256-4370-4934-a131-28e28fbe5939 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:43.871138 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-3c75c256-4370-4934-a131-28e28fbe5939 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/2270d4c1-54d0-468c-acc2-cc2dbc933058" status: 200 len: 1319 microversion: 2.1 time: 0.169930 Jun 30 10:04:43.871700 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 251/518] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:43 2022] GET /compute/v2.1/servers/2270d4c1-54d0-468c-acc2-cc2dbc933058 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:44.426757 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-b07290f1-1c23-4675-88ae-f225bd628a7b tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:44.427699 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-b07290f1-1c23-4675-88ae-f225bd628a7b tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:44.437135 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b07290f1-1c23-4675-88ae-f225bd628a7b tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:44.437575 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b07290f1-1c23-4675-88ae-f225bd628a7b tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:44.438318 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b07290f1-1c23-4675-88ae-f225bd628a7b tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:44.438738 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b07290f1-1c23-4675-88ae-f225bd628a7b tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:44.454048 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:04:44.616604 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-b07290f1-1c23-4675-88ae-f225bd628a7b tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:44.627380 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-b07290f1-1c23-4675-88ae-f225bd628a7b tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1756 microversion: 2.1 time: 0.206962 Jun 30 10:04:44.628828 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 268/519] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:44 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1756 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:44.841157 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-d4d4ecf2-5c61-4215-888b-04811d440b59 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:44.842783 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-d4d4ecf2-5c61-4215-888b-04811d440b59 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 18a19a8d-e121-4f9d-8906-574d6ecce160] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:44.853772 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d4d4ecf2-5c61-4215-888b-04811d440b59 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:44.854500 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d4d4ecf2-5c61-4215-888b-04811d440b59 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:44.855728 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d4d4ecf2-5c61-4215-888b-04811d440b59 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:44.856486 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d4d4ecf2-5c61-4215-888b-04811d440b59 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:44.859350 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:04:44.887369 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-316221e1-6cc1-4699-89d8-608ed3bb6b45 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:44.888010 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-316221e1-6cc1-4699-89d8-608ed3bb6b45 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 2270d4c1-54d0-468c-acc2-cc2dbc933058] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:44.888669 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-d4d4ecf2-5c61-4215-888b-04811d440b59 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054106 Jun 30 10:04:44.889560 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 252/520] 10.222.0.16 () {58 vars in 1301 bytes} [Thu Jun 30 10:04:44 2022] GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:04:44.894681 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-316221e1-6cc1-4699-89d8-608ed3bb6b45 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:44.895124 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-316221e1-6cc1-4699-89d8-608ed3bb6b45 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:44.895908 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-316221e1-6cc1-4699-89d8-608ed3bb6b45 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:44.896331 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-316221e1-6cc1-4699-89d8-608ed3bb6b45 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:45.034646 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-316221e1-6cc1-4699-89d8-608ed3bb6b45 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:45.042460 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-316221e1-6cc1-4699-89d8-608ed3bb6b45 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/2270d4c1-54d0-468c-acc2-cc2dbc933058" status: 200 len: 1319 microversion: 2.1 time: 0.159170 Jun 30 10:04:45.042982 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 269/521] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:44 2022] GET /compute/v2.1/servers/2270d4c1-54d0-468c-acc2-cc2dbc933058 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:04:45.646192 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-0ede4ec3-3d61-497f-9f62-390d9abe1dc5 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:45.646790 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-0ede4ec3-3d61-497f-9f62-390d9abe1dc5 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:45.653011 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-0ede4ec3-3d61-497f-9f62-390d9abe1dc5 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:45.653462 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-0ede4ec3-3d61-497f-9f62-390d9abe1dc5 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:45.654483 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-0ede4ec3-3d61-497f-9f62-390d9abe1dc5 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:45.655306 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-0ede4ec3-3d61-497f-9f62-390d9abe1dc5 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:45.813689 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-0ede4ec3-3d61-497f-9f62-390d9abe1dc5 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:45.822048 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-0ede4ec3-3d61-497f-9f62-390d9abe1dc5 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1756 microversion: 2.1 time: 0.180002 Jun 30 10:04:45.822571 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 253/522] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:45 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:45.901837 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-75d5e773-5891-4080-99ff-04c13526a44b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:45.902766 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-75d5e773-5891-4080-99ff-04c13526a44b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 18a19a8d-e121-4f9d-8906-574d6ecce160] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:45.909736 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-75d5e773-5891-4080-99ff-04c13526a44b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:45.910176 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-75d5e773-5891-4080-99ff-04c13526a44b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:45.910927 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-75d5e773-5891-4080-99ff-04c13526a44b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:45.911352 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-75d5e773-5891-4080-99ff-04c13526a44b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:45.940950 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-75d5e773-5891-4080-99ff-04c13526a44b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043264 Jun 30 10:04:45.941507 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 270/523] 10.222.0.16 () {58 vars in 1301 bytes} [Thu Jun 30 10:04:45 2022] GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:04:46.060025 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-ab5c0598-4091-45fd-9b66-afaf0fdfb487 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:46.060733 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-ab5c0598-4091-45fd-9b66-afaf0fdfb487 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 2270d4c1-54d0-468c-acc2-cc2dbc933058] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:46.067904 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ab5c0598-4091-45fd-9b66-afaf0fdfb487 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:46.068378 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ab5c0598-4091-45fd-9b66-afaf0fdfb487 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:46.069096 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ab5c0598-4091-45fd-9b66-afaf0fdfb487 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:46.069541 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ab5c0598-4091-45fd-9b66-afaf0fdfb487 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:46.211095 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-ab5c0598-4091-45fd-9b66-afaf0fdfb487 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:46.220499 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-ab5c0598-4091-45fd-9b66-afaf0fdfb487 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/2270d4c1-54d0-468c-acc2-cc2dbc933058" status: 200 len: 1319 microversion: 2.1 time: 0.164448 Jun 30 10:04:46.221055 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 254/524] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:46 2022] GET /compute/v2.1/servers/2270d4c1-54d0-468c-acc2-cc2dbc933058 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:46.838891 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-0718ff62-71d1-4fd7-9e22-844bc6c62072 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:46.839417 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-0718ff62-71d1-4fd7-9e22-844bc6c62072 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:46.841372 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=2 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:04:46.842087 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=6 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:04:46.848604 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0718ff62-71d1-4fd7-9e22-844bc6c62072 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:46.849045 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0718ff62-71d1-4fd7-9e22-844bc6c62072 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:46.849826 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0718ff62-71d1-4fd7-9e22-844bc6c62072 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:46.850249 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0718ff62-71d1-4fd7-9e22-844bc6c62072 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:46.954602 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-7ff4eb59-22ce-472a-9cad-de8dc260f00b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:46.955579 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-7ff4eb59-22ce-472a-9cad-de8dc260f00b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 18a19a8d-e121-4f9d-8906-574d6ecce160] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:46.957628 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell0:SELECT=2 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:04:46.963275 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7ff4eb59-22ce-472a-9cad-de8dc260f00b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:46.963736 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7ff4eb59-22ce-472a-9cad-de8dc260f00b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:46.964528 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7ff4eb59-22ce-472a-9cad-de8dc260f00b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:46.964966 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7ff4eb59-22ce-472a-9cad-de8dc260f00b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:46.996886 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-7ff4eb59-22ce-472a-9cad-de8dc260f00b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046408 Jun 30 10:04:46.997681 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 255/525] 10.222.0.16 () {58 vars in 1301 bytes} [Thu Jun 30 10:04:46 2022] GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:04:47.002465 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-0718ff62-71d1-4fd7-9e22-844bc6c62072 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:47.010319 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-0718ff62-71d1-4fd7-9e22-844bc6c62072 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1756 microversion: 2.1 time: 0.175489 Jun 30 10:04:47.010906 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 271/526] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:46 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:47.239195 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-2abea12b-b337-474f-b011-1970cfc85e73 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:47.240470 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-2abea12b-b337-474f-b011-1970cfc85e73 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 2270d4c1-54d0-468c-acc2-cc2dbc933058] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:47.247392 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2abea12b-b337-474f-b011-1970cfc85e73 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:47.247924 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2abea12b-b337-474f-b011-1970cfc85e73 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:47.248881 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2abea12b-b337-474f-b011-1970cfc85e73 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:47.249369 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2abea12b-b337-474f-b011-1970cfc85e73 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:47.270315 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-5170bdad-ce0d-434a-9de8-9a0675ddbe35 req-bfbadaaa-1288-4882-a3e2-53dddcd1738d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2270d4c1-54d0-468c-acc2-cc2dbc933058", "name": "network-vif-plugged", "status": "completed", "tag": "703ecae9-4d65-4a21-99c8-e614d4240eda"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:04:47.294018 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-5170bdad-ce0d-434a-9de8-9a0675ddbe35 req-bfbadaaa-1288-4882-a3e2-53dddcd1738d service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:47.294155 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-5170bdad-ce0d-434a-9de8-9a0675ddbe35 req-bfbadaaa-1288-4882-a3e2-53dddcd1738d service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:47.306228 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-5170bdad-ce0d-434a-9de8-9a0675ddbe35 req-bfbadaaa-1288-4882-a3e2-53dddcd1738d service nova] Creating event network-vif-plugged:703ecae9-4d65-4a21-99c8-e614d4240eda for instance 2270d4c1-54d0-468c-acc2-cc2dbc933058 on hv-cinder-84330 Jun 30 10:04:47.312005 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-5170bdad-ce0d-434a-9de8-9a0675ddbe35 req-bfbadaaa-1288-4882-a3e2-53dddcd1738d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044988 Jun 30 10:04:47.313144 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 272/527] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:04:47.352703 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-5a54517d-1014-4bcb-a100-40d6dacb3d16 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:04:47.353993 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-5a54517d-1014-4bcb-a100-40d6dacb3d16 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:47.362036 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5a54517d-1014-4bcb-a100-40d6dacb3d16 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:47.362741 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5a54517d-1014-4bcb-a100-40d6dacb3d16 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:47.363690 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5a54517d-1014-4bcb-a100-40d6dacb3d16 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:47.364324 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5a54517d-1014-4bcb-a100-40d6dacb3d16 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:47.392914 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.objects.instance [None req-5a54517d-1014-4bcb-a100-40d6dacb3d16 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lazy-loading 'flavor' on Instance uuid 114a9363-7f11-4906-959f-37a7d3275e52 {{(pid=117846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:04:47.406554 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-2abea12b-b337-474f-b011-1970cfc85e73 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:47.414740 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-2abea12b-b337-474f-b011-1970cfc85e73 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/2270d4c1-54d0-468c-acc2-cc2dbc933058" status: 200 len: 1319 microversion: 2.1 time: 0.180802 Jun 30 10:04:47.415315 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 256/528] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:47 2022] GET /compute/v2.1/servers/2270d4c1-54d0-468c-acc2-cc2dbc933058 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:47.527620 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-5a54517d-1014-4bcb-a100-40d6dacb3d16 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "POST /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52/action" status: 200 len: 32 microversion: 2.1 time: 0.180815 Jun 30 10:04:47.528364 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 273/529] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Jun 30 10:04:47 2022] POST /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52/action => generated 32 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 30 10:04:47.538113 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-bc34f54d-8181-4cf9-a24f-fbc8e8b613af tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:47.539092 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-bc34f54d-8181-4cf9-a24f-fbc8e8b613af tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:47.545426 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-bc34f54d-8181-4cf9-a24f-fbc8e8b613af tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:47.545980 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-bc34f54d-8181-4cf9-a24f-fbc8e8b613af tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:47.546821 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-bc34f54d-8181-4cf9-a24f-fbc8e8b613af tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:47.547321 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-bc34f54d-8181-4cf9-a24f-fbc8e8b613af tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:47.685490 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-bc34f54d-8181-4cf9-a24f-fbc8e8b613af tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:47.694176 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-bc34f54d-8181-4cf9-a24f-fbc8e8b613af tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1736 microversion: 2.1 time: 0.159960 Jun 30 10:04:47.694730 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 257/530] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:47 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:48.010617 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-16ea8359-bc35-40f3-9b9b-00b0edbf5013 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:48.011668 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-16ea8359-bc35-40f3-9b9b-00b0edbf5013 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 18a19a8d-e121-4f9d-8906-574d6ecce160] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:48.018150 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-16ea8359-bc35-40f3-9b9b-00b0edbf5013 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:48.018592 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-16ea8359-bc35-40f3-9b9b-00b0edbf5013 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:48.019331 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-16ea8359-bc35-40f3-9b9b-00b0edbf5013 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:48.019750 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-16ea8359-bc35-40f3-9b9b-00b0edbf5013 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:48.027927 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-d6aa2748-3059-43c9-a83c-9b57e90d2574 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:48.028547 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-d6aa2748-3059-43c9-a83c-9b57e90d2574 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:48.035219 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d6aa2748-3059-43c9-a83c-9b57e90d2574 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:48.035671 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d6aa2748-3059-43c9-a83c-9b57e90d2574 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:48.036475 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d6aa2748-3059-43c9-a83c-9b57e90d2574 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:48.036909 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d6aa2748-3059-43c9-a83c-9b57e90d2574 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:48.049577 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-16ea8359-bc35-40f3-9b9b-00b0edbf5013 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043640 Jun 30 10:04:48.050145 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 274/531] 10.222.0.16 () {58 vars in 1301 bytes} [Thu Jun 30 10:04:48 2022] GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 10:04:48.107295 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-6942ed72-a515-49c7-b012-e1d6e1a6c33f tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:48.107780 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-6942ed72-a515-49c7-b012-e1d6e1a6c33f tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 18a19a8d-e121-4f9d-8906-574d6ecce160] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:48.114338 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6942ed72-a515-49c7-b012-e1d6e1a6c33f tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:48.114791 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6942ed72-a515-49c7-b012-e1d6e1a6c33f tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:48.115566 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6942ed72-a515-49c7-b012-e1d6e1a6c33f tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:48.116032 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6942ed72-a515-49c7-b012-e1d6e1a6c33f tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:48.144102 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-6942ed72-a515-49c7-b012-e1d6e1a6c33f tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 18a19a8d-e121-4f9d-8906-574d6ecce160] Going to try to terminate instance {{(pid=117846) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 10:04:48.190573 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-d6aa2748-3059-43c9-a83c-9b57e90d2574 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:48.198592 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-d6aa2748-3059-43c9-a83c-9b57e90d2574 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1756 microversion: 2.1 time: 0.174696 Jun 30 10:04:48.199158 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 258/532] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:48 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:48.221881 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-6942ed72-a515-49c7-b012-e1d6e1a6c33f tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "DELETE /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160" status: 204 len: 0 microversion: 2.1 time: 0.118376 Jun 30 10:04:48.222467 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 275/533] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 10:04:48 2022] DELETE /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 10:04:48.230767 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-713d945d-3998-41c5-91dd-be90be5a0ee2 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:48.231444 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-713d945d-3998-41c5-91dd-be90be5a0ee2 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 18a19a8d-e121-4f9d-8906-574d6ecce160] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:48.237702 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-713d945d-3998-41c5-91dd-be90be5a0ee2 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:48.238175 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-713d945d-3998-41c5-91dd-be90be5a0ee2 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:48.238931 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-713d945d-3998-41c5-91dd-be90be5a0ee2 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:48.239360 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-713d945d-3998-41c5-91dd-be90be5a0ee2 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:48.408424 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-713d945d-3998-41c5-91dd-be90be5a0ee2 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:48.418559 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-713d945d-3998-41c5-91dd-be90be5a0ee2 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160" status: 200 len: 1682 microversion: 2.1 time: 0.191313 Jun 30 10:04:48.419347 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 259/534] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:48 2022] GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160 => generated 1682 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:48.434265 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-769649f0-a6ff-4779-9c0f-670ffdbb2ce6 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:48.434966 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-769649f0-a6ff-4779-9c0f-670ffdbb2ce6 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 2270d4c1-54d0-468c-acc2-cc2dbc933058] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:48.441936 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-769649f0-a6ff-4779-9c0f-670ffdbb2ce6 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:48.442298 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-769649f0-a6ff-4779-9c0f-670ffdbb2ce6 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:48.443076 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-769649f0-a6ff-4779-9c0f-670ffdbb2ce6 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:48.443502 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-769649f0-a6ff-4779-9c0f-670ffdbb2ce6 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:48.591904 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-769649f0-a6ff-4779-9c0f-670ffdbb2ce6 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:48.599501 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-769649f0-a6ff-4779-9c0f-670ffdbb2ce6 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/2270d4c1-54d0-468c-acc2-cc2dbc933058" status: 200 len: 1319 microversion: 2.1 time: 0.170267 Jun 30 10:04:48.600088 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 276/535] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:48 2022] GET /compute/v2.1/servers/2270d4c1-54d0-468c-acc2-cc2dbc933058 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:48.715582 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-65c9916d-03ee-4821-9f1f-1dfc2f5d6691 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:48.716516 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-65c9916d-03ee-4821-9f1f-1dfc2f5d6691 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:48.726673 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-65c9916d-03ee-4821-9f1f-1dfc2f5d6691 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:48.727413 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-65c9916d-03ee-4821-9f1f-1dfc2f5d6691 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:48.728758 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-65c9916d-03ee-4821-9f1f-1dfc2f5d6691 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:48.729485 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-65c9916d-03ee-4821-9f1f-1dfc2f5d6691 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:48.872543 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-65c9916d-03ee-4821-9f1f-1dfc2f5d6691 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:48.880943 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-65c9916d-03ee-4821-9f1f-1dfc2f5d6691 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1736 microversion: 2.1 time: 0.171972 Jun 30 10:04:48.881509 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 260/536] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:48 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:49.220565 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-fcd41563-a581-4865-80f4-aa4cc8005045 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:49.221639 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-fcd41563-a581-4865-80f4-aa4cc8005045 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:49.232809 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fcd41563-a581-4865-80f4-aa4cc8005045 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:49.232997 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fcd41563-a581-4865-80f4-aa4cc8005045 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:49.233715 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fcd41563-a581-4865-80f4-aa4cc8005045 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:49.234135 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fcd41563-a581-4865-80f4-aa4cc8005045 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:49.381837 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-fcd41563-a581-4865-80f4-aa4cc8005045 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:49.390141 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-fcd41563-a581-4865-80f4-aa4cc8005045 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1756 microversion: 2.1 time: 0.176226 Jun 30 10:04:49.390710 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 277/537] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:49 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:49.439426 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-62eef720-0d03-4e19-a937-3cf24a1b0181 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:49.440366 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-62eef720-0d03-4e19-a937-3cf24a1b0181 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 18a19a8d-e121-4f9d-8906-574d6ecce160] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:49.450384 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-62eef720-0d03-4e19-a937-3cf24a1b0181 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:49.451124 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-62eef720-0d03-4e19-a937-3cf24a1b0181 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:49.451865 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-62eef720-0d03-4e19-a937-3cf24a1b0181 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:49.452323 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-62eef720-0d03-4e19-a937-3cf24a1b0181 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:49.595927 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-62eef720-0d03-4e19-a937-3cf24a1b0181 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:49.607547 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-62eef720-0d03-4e19-a937-3cf24a1b0181 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160" status: 200 len: 1682 microversion: 2.1 time: 0.173652 Jun 30 10:04:49.608312 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 261/538] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:49 2022] GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160 => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:04:49.619726 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-cfc28c15-9ee9-41f4-b0ec-8a04ec5a8ed2 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:49.620521 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-cfc28c15-9ee9-41f4-b0ec-8a04ec5a8ed2 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 2270d4c1-54d0-468c-acc2-cc2dbc933058] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:49.627411 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cfc28c15-9ee9-41f4-b0ec-8a04ec5a8ed2 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:49.627849 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cfc28c15-9ee9-41f4-b0ec-8a04ec5a8ed2 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:49.628626 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cfc28c15-9ee9-41f4-b0ec-8a04ec5a8ed2 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:49.629050 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cfc28c15-9ee9-41f4-b0ec-8a04ec5a8ed2 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:49.768442 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-cfc28c15-9ee9-41f4-b0ec-8a04ec5a8ed2 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:49.779477 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-cfc28c15-9ee9-41f4-b0ec-8a04ec5a8ed2 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/2270d4c1-54d0-468c-acc2-cc2dbc933058" status: 200 len: 1319 microversion: 2.1 time: 0.165595 Jun 30 10:04:49.780069 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 278/539] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:49 2022] GET /compute/v2.1/servers/2270d4c1-54d0-468c-acc2-cc2dbc933058 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:49.902164 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-17ad6cb0-de8b-460d-8a3b-71f943346dde tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:49.903153 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-17ad6cb0-de8b-460d-8a3b-71f943346dde tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:49.910140 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-17ad6cb0-de8b-460d-8a3b-71f943346dde tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:49.910582 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-17ad6cb0-de8b-460d-8a3b-71f943346dde tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:49.911334 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-17ad6cb0-de8b-460d-8a3b-71f943346dde tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:49.911764 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-17ad6cb0-de8b-460d-8a3b-71f943346dde tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:50.051391 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-17ad6cb0-de8b-460d-8a3b-71f943346dde tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:50.062926 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-17ad6cb0-de8b-460d-8a3b-71f943346dde tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1736 microversion: 2.1 time: 0.167260 Jun 30 10:04:50.063671 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 262/540] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:49 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:50.407475 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-b3d4bbc2-0a7f-4661-ae91-c8a24a8b9ab6 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:50.408070 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-b3d4bbc2-0a7f-4661-ae91-c8a24a8b9ab6 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:50.417804 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b3d4bbc2-0a7f-4661-ae91-c8a24a8b9ab6 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:50.418395 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b3d4bbc2-0a7f-4661-ae91-c8a24a8b9ab6 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:50.419407 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b3d4bbc2-0a7f-4661-ae91-c8a24a8b9ab6 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:50.420009 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b3d4bbc2-0a7f-4661-ae91-c8a24a8b9ab6 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:50.628672 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-7c48dae5-91b4-4527-a0f8-7aac76a9f556 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:50.629336 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-7c48dae5-91b4-4527-a0f8-7aac76a9f556 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 18a19a8d-e121-4f9d-8906-574d6ecce160] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:50.631617 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-b3d4bbc2-0a7f-4661-ae91-c8a24a8b9ab6 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:50.636004 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7c48dae5-91b4-4527-a0f8-7aac76a9f556 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:50.636453 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7c48dae5-91b4-4527-a0f8-7aac76a9f556 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:50.637212 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7c48dae5-91b4-4527-a0f8-7aac76a9f556 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:50.637638 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7c48dae5-91b4-4527-a0f8-7aac76a9f556 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:50.640325 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-b3d4bbc2-0a7f-4661-ae91-c8a24a8b9ab6 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1756 microversion: 2.1 time: 0.237352 Jun 30 10:04:50.640986 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 279/541] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:50 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1756 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:50.772842 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-7c48dae5-91b4-4527-a0f8-7aac76a9f556 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:50.780727 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-7c48dae5-91b4-4527-a0f8-7aac76a9f556 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160" status: 200 len: 1682 microversion: 2.1 time: 0.155933 Jun 30 10:04:50.781288 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 263/542] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:50 2022] GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:50.797820 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-14667bcb-99ec-4644-9a33-995f312d54fa tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:50.798417 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-14667bcb-99ec-4644-9a33-995f312d54fa tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 2270d4c1-54d0-468c-acc2-cc2dbc933058] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:50.804772 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-14667bcb-99ec-4644-9a33-995f312d54fa tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:50.805145 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-14667bcb-99ec-4644-9a33-995f312d54fa tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:50.805887 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-14667bcb-99ec-4644-9a33-995f312d54fa tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:50.806337 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-14667bcb-99ec-4644-9a33-995f312d54fa tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:50.935965 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-14667bcb-99ec-4644-9a33-995f312d54fa tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:50.946556 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-14667bcb-99ec-4644-9a33-995f312d54fa tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/2270d4c1-54d0-468c-acc2-cc2dbc933058" status: 200 len: 1509 microversion: 2.1 time: 0.153014 Jun 30 10:04:50.947366 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 280/543] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:50 2022] GET /compute/v2.1/servers/2270d4c1-54d0-468c-acc2-cc2dbc933058 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:50.963663 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-64414d24-d277-434e-8798-2811c94973f7 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "781ce365-6024-4312-8075-fbbf3724293b", "device": "/dev/sdb"}} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:04:50.965330 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-64414d24-d277-434e-8798-2811c94973f7 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 2270d4c1-54d0-468c-acc2-cc2dbc933058] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:50.972322 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-64414d24-d277-434e-8798-2811c94973f7 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:50.972772 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-64414d24-d277-434e-8798-2811c94973f7 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:50.973521 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-64414d24-d277-434e-8798-2811c94973f7 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:50.973955 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-64414d24-d277-434e-8798-2811c94973f7 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:51.080305 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-4db80073-ebae-4e7c-89ca-fdd0d63cfb88 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:51.081221 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-4db80073-ebae-4e7c-89ca-fdd0d63cfb88 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:51.087864 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4db80073-ebae-4e7c-89ca-fdd0d63cfb88 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:51.088604 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4db80073-ebae-4e7c-89ca-fdd0d63cfb88 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:51.089379 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4db80073-ebae-4e7c-89ca-fdd0d63cfb88 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:51.089912 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4db80073-ebae-4e7c-89ca-fdd0d63cfb88 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:51.242159 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-64414d24-d277-434e-8798-2811c94973f7 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "POST /compute/v2.1/servers/2270d4c1-54d0-468c-acc2-cc2dbc933058/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282315 Jun 30 10:04:51.242875 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 264/544] 10.222.0.16 () {60 vars in 1322 bytes} [Thu Jun 30 10:04:50 2022] POST /compute/v2.1/servers/2270d4c1-54d0-468c-acc2-cc2dbc933058/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:04:51.311039 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-4db80073-ebae-4e7c-89ca-fdd0d63cfb88 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:51.319420 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-4db80073-ebae-4e7c-89ca-fdd0d63cfb88 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1736 microversion: 2.1 time: 0.243287 Jun 30 10:04:51.320102 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 281/545] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:51 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1736 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:51.658500 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-a67bc8d8-a3d5-4f5b-9485-19ede28f0899 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:51.659191 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-a67bc8d8-a3d5-4f5b-9485-19ede28f0899 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:51.666318 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a67bc8d8-a3d5-4f5b-9485-19ede28f0899 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:51.666735 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a67bc8d8-a3d5-4f5b-9485-19ede28f0899 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:51.667495 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a67bc8d8-a3d5-4f5b-9485-19ede28f0899 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:51.667953 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a67bc8d8-a3d5-4f5b-9485-19ede28f0899 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:51.804286 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f0238ea4-b2af-4716-8995-86e938cf571b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:51.804907 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f0238ea4-b2af-4716-8995-86e938cf571b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 18a19a8d-e121-4f9d-8906-574d6ecce160] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:51.812189 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f0238ea4-b2af-4716-8995-86e938cf571b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:51.812628 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f0238ea4-b2af-4716-8995-86e938cf571b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:51.813432 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f0238ea4-b2af-4716-8995-86e938cf571b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:51.813835 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f0238ea4-b2af-4716-8995-86e938cf571b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:51.830618 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:04:51.895415 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f0238ea4-b2af-4716-8995-86e938cf571b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:51.902930 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f0238ea4-b2af-4716-8995-86e938cf571b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160" status: 200 len: 1614 microversion: 2.1 time: 0.103711 Jun 30 10:04:51.903532 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 282/546] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:51 2022] GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160 => generated 1614 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:51.930520 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-a67bc8d8-a3d5-4f5b-9485-19ede28f0899 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:51.939013 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-a67bc8d8-a3d5-4f5b-9485-19ede28f0899 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1756 microversion: 2.1 time: 0.285386 Jun 30 10:04:51.939578 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 265/547] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:51 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1756 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:52.094183 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-fdc73c51-7f5c-41c1-9a86-62074c40e493 req-577a6be8-cb11-4371-97f5-0fbbbf228616 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18a19a8d-e121-4f9d-8906-574d6ecce160", "name": "network-vif-deleted", "tag": "1b857dd1-e79c-49ad-bc35-e8f33b08e271"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:04:52.104586 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-fdc73c51-7f5c-41c1-9a86-62074c40e493 req-577a6be8-cb11-4371-97f5-0fbbbf228616 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:52.105021 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-fdc73c51-7f5c-41c1-9a86-62074c40e493 req-577a6be8-cb11-4371-97f5-0fbbbf228616 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:52.116896 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-fdc73c51-7f5c-41c1-9a86-62074c40e493 req-577a6be8-cb11-4371-97f5-0fbbbf228616 service nova] Creating event network-vif-deleted:1b857dd1-e79c-49ad-bc35-e8f33b08e271 for instance 18a19a8d-e121-4f9d-8906-574d6ecce160 on hv-cinder-84330 Jun 30 10:04:52.121886 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-fdc73c51-7f5c-41c1-9a86-62074c40e493 req-577a6be8-cb11-4371-97f5-0fbbbf228616 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032895 Jun 30 10:04:52.125874 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 283/548] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:04:52.337952 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-52f2dd42-100b-4463-b47b-479290cfaf71 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:52.338841 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-52f2dd42-100b-4463-b47b-479290cfaf71 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:52.345053 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:04:52.346871 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-52f2dd42-100b-4463-b47b-479290cfaf71 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:52.347665 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-52f2dd42-100b-4463-b47b-479290cfaf71 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:52.348618 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-52f2dd42-100b-4463-b47b-479290cfaf71 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:52.349225 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-52f2dd42-100b-4463-b47b-479290cfaf71 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:52.751915 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-52f2dd42-100b-4463-b47b-479290cfaf71 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:52.760235 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-52f2dd42-100b-4463-b47b-479290cfaf71 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1736 microversion: 2.1 time: 0.426087 Jun 30 10:04:52.760811 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 266/549] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:52 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1736 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:52.921536 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-13cc1d9c-0db2-42ba-b731-7e0a132e9312 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:52.922226 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-13cc1d9c-0db2-42ba-b731-7e0a132e9312 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 18a19a8d-e121-4f9d-8906-574d6ecce160] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:52.929137 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-13cc1d9c-0db2-42ba-b731-7e0a132e9312 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:52.929583 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-13cc1d9c-0db2-42ba-b731-7e0a132e9312 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:52.930356 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-13cc1d9c-0db2-42ba-b731-7e0a132e9312 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:52.930771 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-13cc1d9c-0db2-42ba-b731-7e0a132e9312 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:52.946490 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-13cc1d9c-0db2-42ba-b731-7e0a132e9312 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] HTTP exception thrown: Instance 18a19a8d-e121-4f9d-8906-574d6ecce160 could not be found. Jun 30 10:04:52.948235 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-13cc1d9c-0db2-42ba-b731-7e0a132e9312 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Request method failure captured: Jun 30 10:04:52.948235 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: request: GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160 HTTP/1.1 Jun 30 10:04:52.948235 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept: application/json Jun 30 10:04:52.948235 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jun 30 10:04:52.948235 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Connection: close Jun 30 10:04:52.948235 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jun 30 10:04:52.948235 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jun 30 10:04:52.948235 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Host: 10.222.0.16 Jun 30 10:04:52.948235 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jun 30 10:04:52.948235 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jun 30 10:04:52.948235 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABivXRKWOm8okSqawQyEyFIlPPo5ED3-MkteEmCjIwaTuHRpOC0yz7t-S9pF6F_OHxcNFTgq2ZVvCBW8WpcDzubzrkM7lZXCNWSzcj1P8TCpyHfDpEvKKwyetYBPaKEvw3fBqcARKuB5F-oWIrvkHJpnEC8cyolAJOOfEpEG7HP2E8WCR8 Jun 30 10:04:52.948235 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jun 30 10:04:52.948235 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jun 30 10:04:52.948235 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jun 30 10:04:52.948235 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jun 30 10:04:52.948235 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jun 30 10:04:52.948235 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jun 30 10:04:52.948235 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Id: 2e55dd4580184f158efedbad5dc6e8fb Jun 30 10:04:52.948235 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-AttachVolumeNegativeTest-821277988 Jun 30 10:04:52.948235 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Role: reader,member Jun 30 10:04:52.948235 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Roles: reader,member Jun 30 10:04:52.949610 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:04:52.949610 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-AttachVolumeNegativeTest-821277988 Jun 30 10:04:52.949610 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 2e55dd4580184f158efedbad5dc6e8fb Jun 30 10:04:52.949610 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-821277988 Jun 30 10:04:52.949610 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User: tempest-AttachVolumeNegativeTest-821277988-project Jun 30 10:04:52.949610 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jun 30 10:04:52.949610 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jun 30 10:04:52.949610 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Id: 4e9ad2c4909c49a6b3df8ece333e70b5 Jun 30 10:04:52.949610 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-AttachVolumeNegativeTest-821277988-project Jun 30 10:04:52.949610 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: method: > Jun 30 10:04:52.949610 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: exception: Instance 18a19a8d-e121-4f9d-8906-574d6ecce160 could not be found. Jun 30 10:04:52.949610 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: action_args: {'id': '18a19a8d-e121-4f9d-8906-574d6ecce160'} Jun 30 10:04:52.950533 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:04:52.950533 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:04:52.950533 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:04:52.950533 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:04:52.950533 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:04:52.950533 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:04:52.950533 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:04:52.950533 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:04:52.950533 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:04:52.950533 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:04:52.950533 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18a19a8d-e121-4f9d-8906-574d6ecce160 could not be found. Jun 30 10:04:52.950533 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:04:52.950533 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:04:52.950533 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:04:52.950533 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:04:52.950533 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:04:52.950533 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:04:52.950533 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:04:52.950533 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:04:52.950533 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:04:52.952358 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:04:52.952358 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:04:52.952358 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:04:52.952358 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:04:52.952358 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:04:52.952358 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:04:52.952358 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:04:52.952358 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18a19a8d-e121-4f9d-8906-574d6ecce160 could not be found. Jun 30 10:04:52.952358 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:04:52.952358 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:04:52.952358 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:04:52.952358 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:04:52.952358 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:04:52.952358 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:04:52.952358 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:04:52.952358 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:04:52.952358 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18a19a8d-e121-4f9d-8906-574d6ecce160 could not be found. Jun 30 10:04:52.952358 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:04:52.953626 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-13cc1d9c-0db2-42ba-b731-7e0a132e9312 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Returning 404 to user: Instance 18a19a8d-e121-4f9d-8906-574d6ecce160 could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:04:52.953626 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-13cc1d9c-0db2-42ba-b731-7e0a132e9312 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160" status: 404 len: 111 microversion: 2.1 time: 0.033023 Jun 30 10:04:52.953626 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 284/550] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:52 2022] GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:04:52.960221 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-a51b5bb9-e523-4d88-b91d-5e1feec79cdf tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:52.960447 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-abe19c76-898b-4264-b306-16e225032b79 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '.version_select at 0x7fc2204abaf0>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:52.960844 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-a51b5bb9-e523-4d88-b91d-5e1feec79cdf tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:52.968148 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a51b5bb9-e523-4d88-b91d-5e1feec79cdf tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:52.968611 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a51b5bb9-e523-4d88-b91d-5e1feec79cdf tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:52.969376 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a51b5bb9-e523-4d88-b91d-5e1feec79cdf tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:52.969779 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a51b5bb9-e523-4d88-b91d-5e1feec79cdf tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:52.983991 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-abe19c76-898b-4264-b306-16e225032b79 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-286661884" status: 202 len: 0 microversion: 2.1 time: 0.027556 Jun 30 10:04:52.984676 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 285/551] 10.222.0.16 () {58 vars in 1217 bytes} [Thu Jun 30 10:04:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-286661884 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:04:52.987714 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:04:53.155567 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-a51b5bb9-e523-4d88-b91d-5e1feec79cdf tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:53.171100 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-a51b5bb9-e523-4d88-b91d-5e1feec79cdf tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1756 microversion: 2.1 time: 0.215963 Jun 30 10:04:53.172308 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 267/552] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:52 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1756 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:53.653919 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-2bbb6d3b-b1ed-4e06-97f6-e2e7b6f1869d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Action: 'create', calling method: .version_select at 0x7fc220273ca0>, body: {"keypair": {"name": "tempest-keypair-992862654", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/AzEROxePRBX68JO7zRj9ySB5nP8teah5N+2Fn7V3VeorIEMOuUO+QIEpPmNxq0TYEOafPCiskEoBBNNxvWOlt9D5OlS2mtN8J6VyohZYkCFCw+1EgubbX8Cn8elllug=="}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:04:53.663283 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:04:53.669958 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-2bbb6d3b-b1ed-4e06-97f6-e2e7b6f1869d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Getting quotas for project 2e55dd4580184f158efedbad5dc6e8fb. Resources: {'key_pairs'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:04:53.675661 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-2bbb6d3b-b1ed-4e06-97f6-e2e7b6f1869d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Getting quotas for user 4e9ad2c4909c49a6b3df8ece333e70b5 and project 2e55dd4580184f158efedbad5dc6e8fb. Resources: {'key_pairs'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:04:53.700322 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-2bbb6d3b-b1ed-4e06-97f6-e2e7b6f1869d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050734 Jun 30 10:04:53.701065 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 286/553] 10.222.0.16 () {60 vars in 1158 bytes} [Thu Jun 30 10:04:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:04:53.777778 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-7a2bce11-729c-4c5c-8128-6d1b5e5ed092 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:53.778355 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-7a2bce11-729c-4c5c-8128-6d1b5e5ed092 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:53.784943 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7a2bce11-729c-4c5c-8128-6d1b5e5ed092 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:53.785874 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7a2bce11-729c-4c5c-8128-6d1b5e5ed092 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:53.786662 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7a2bce11-729c-4c5c-8128-6d1b5e5ed092 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:53.787085 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7a2bce11-729c-4c5c-8128-6d1b5e5ed092 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:53.934636 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-7a2bce11-729c-4c5c-8128-6d1b5e5ed092 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:53.944185 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-7a2bce11-729c-4c5c-8128-6d1b5e5ed092 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1736 microversion: 2.1 time: 0.170636 Jun 30 10:04:53.944779 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 268/554] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:53 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:54.189225 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-2f71931d-f82e-4023-8aaa-e4ff37e8fdbf tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:54.190136 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-2f71931d-f82e-4023-8aaa-e4ff37e8fdbf tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:54.196505 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2f71931d-f82e-4023-8aaa-e4ff37e8fdbf tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:54.196945 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2f71931d-f82e-4023-8aaa-e4ff37e8fdbf tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:54.197696 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2f71931d-f82e-4023-8aaa-e4ff37e8fdbf tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:54.198117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2f71931d-f82e-4023-8aaa-e4ff37e8fdbf tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:54.343322 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-2f71931d-f82e-4023-8aaa-e4ff37e8fdbf tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:54.351862 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-2f71931d-f82e-4023-8aaa-e4ff37e8fdbf tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1756 microversion: 2.1 time: 0.167104 Jun 30 10:04:54.352759 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 287/555] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:54 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:54.962107 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-33cbf664-43bf-4584-a6b5-0648e642e1b7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:54.962821 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-33cbf664-43bf-4584-a6b5-0648e642e1b7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:54.969717 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-33cbf664-43bf-4584-a6b5-0648e642e1b7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:54.970232 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-33cbf664-43bf-4584-a6b5-0648e642e1b7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:54.971051 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-33cbf664-43bf-4584-a6b5-0648e642e1b7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:54.971549 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-33cbf664-43bf-4584-a6b5-0648e642e1b7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:55.011864 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-eec608d9-8ecc-4c56-836b-4e26ae301577 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-128457232", "imageRef": "c9dccba6-70d7-4aa8-9b8f-9c88ef1af443", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0141f079-f9f5-43fa-9ae7-09ea5e157c2e"}], "security_groups": [{"name": "tempest-securitygroup--456036392"}], "key_name": "tempest-keypair-992862654", "user_data": "}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:04:55.137333 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-33cbf664-43bf-4584-a6b5-0648e642e1b7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:55.141276 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.network.neutron [None req-eec608d9-8ecc-4c56-836b-4e26ae301577 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] validate_networks() for [('0141f079-f9f5-43fa-9ae7-09ea5e157c2e', None, None, None, None, None)] {{(pid=117846) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 10:04:55.146102 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-33cbf664-43bf-4584-a6b5-0648e642e1b7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1736 microversion: 2.1 time: 0.187680 Jun 30 10:04:55.147033 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 269/556] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:54 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1736 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:55.369496 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-2a5ad4e0-feae-44b8-b8c0-aee6869d776e tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:55.370088 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-2a5ad4e0-feae-44b8-b8c0-aee6869d776e tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:55.376421 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2a5ad4e0-feae-44b8-b8c0-aee6869d776e tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:55.376860 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2a5ad4e0-feae-44b8-b8c0-aee6869d776e tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:55.377606 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2a5ad4e0-feae-44b8-b8c0-aee6869d776e tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:55.378002 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2a5ad4e0-feae-44b8-b8c0-aee6869d776e tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:55.610118 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-2a5ad4e0-feae-44b8-b8c0-aee6869d776e tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:55.616259 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-eec608d9-8ecc-4c56-836b-4e26ae301577 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Flavor limits 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 10:04:55.616759 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-eec608d9-8ecc-4c56-836b-4e26ae301577 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Image limits 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 10:04:55.617244 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-eec608d9-8ecc-4c56-836b-4e26ae301577 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Flavor pref 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 10:04:55.617703 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-eec608d9-8ecc-4c56-836b-4e26ae301577 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Image pref 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 10:04:55.618168 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-eec608d9-8ecc-4c56-836b-4e26ae301577 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 10:04:55.618583 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-2a5ad4e0-feae-44b8-b8c0-aee6869d776e tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1756 microversion: 2.1 time: 0.252911 Jun 30 10:04:55.619143 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 270/557] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:55 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1756 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:55.627691 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-eec608d9-8ecc-4c56-836b-4e26ae301577 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:55.628237 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-eec608d9-8ecc-4c56-836b-4e26ae301577 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:55.629098 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-eec608d9-8ecc-4c56-836b-4e26ae301577 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:55.629523 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-eec608d9-8ecc-4c56-836b-4e26ae301577 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:55.646688 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-eec608d9-8ecc-4c56-836b-4e26ae301577 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Getting quotas for project 2e55dd4580184f158efedbad5dc6e8fb. Resources: {'ram', 'instances', 'cores'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:04:55.650675 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-eec608d9-8ecc-4c56-836b-4e26ae301577 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Getting quotas for user 4e9ad2c4909c49a6b3df8ece333e70b5 and project 2e55dd4580184f158efedbad5dc6e8fb. Resources: {'ram', 'instances', 'cores'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:04:55.661957 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-eec608d9-8ecc-4c56-836b-4e26ae301577 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Going to run 1 instances... {{(pid=117846) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 10:04:55.664206 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-eec608d9-8ecc-4c56-836b-4e26ae301577 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 83e934b3-db47-4ab2-a42e-252f5edb6cee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9dccba6-70d7-4aa8-9b8f-9c88ef1af443',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117846) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 10:04:55.713791 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-eec608d9-8ecc-4c56-836b-4e26ae301577 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.706114 Jun 30 10:04:55.714424 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 288/558] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jun 30 10:04:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 10:04:55.724512 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-73feb2c6-5951-492a-8623-908acfaae865 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:55.725115 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-73feb2c6-5951-492a-8623-908acfaae865 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 83e934b3-db47-4ab2-a42e-252f5edb6cee] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:55.781015 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-73feb2c6-5951-492a-8623-908acfaae865 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:55.787836 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-73feb2c6-5951-492a-8623-908acfaae865 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee" status: 200 len: 1240 microversion: 2.1 time: 0.067193 Jun 30 10:04:55.788422 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 271/559] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:55 2022] GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:56.163637 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-5b740a1d-571b-4d7a-9172-ad9371a264ae tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:56.164306 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-5b740a1d-571b-4d7a-9172-ad9371a264ae tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:56.170763 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5b740a1d-571b-4d7a-9172-ad9371a264ae tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:56.171209 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5b740a1d-571b-4d7a-9172-ad9371a264ae tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:56.172003 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5b740a1d-571b-4d7a-9172-ad9371a264ae tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:56.172408 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5b740a1d-571b-4d7a-9172-ad9371a264ae tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:56.306368 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-5b740a1d-571b-4d7a-9172-ad9371a264ae tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:56.314576 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-5b740a1d-571b-4d7a-9172-ad9371a264ae tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1736 microversion: 2.1 time: 0.155334 Jun 30 10:04:56.315487 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 289/560] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:56 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:04:56.637057 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-24f06867-5c3c-455a-a51c-57d6d2abda27 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:56.637661 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-24f06867-5c3c-455a-a51c-57d6d2abda27 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:56.645087 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-24f06867-5c3c-455a-a51c-57d6d2abda27 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:56.645526 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-24f06867-5c3c-455a-a51c-57d6d2abda27 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:56.646284 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-24f06867-5c3c-455a-a51c-57d6d2abda27 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:56.646704 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-24f06867-5c3c-455a-a51c-57d6d2abda27 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:56.806586 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-eb4b414e-023b-4a79-88d3-584a59d0b005 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:56.807851 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-eb4b414e-023b-4a79-88d3-584a59d0b005 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 83e934b3-db47-4ab2-a42e-252f5edb6cee] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:56.815056 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-eb4b414e-023b-4a79-88d3-584a59d0b005 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:56.815740 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-eb4b414e-023b-4a79-88d3-584a59d0b005 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:56.816694 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-eb4b414e-023b-4a79-88d3-584a59d0b005 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:56.817292 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-eb4b414e-023b-4a79-88d3-584a59d0b005 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:56.840725 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-24f06867-5c3c-455a-a51c-57d6d2abda27 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:56.850889 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-24f06867-5c3c-455a-a51c-57d6d2abda27 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1756 microversion: 2.1 time: 0.217491 Jun 30 10:04:56.851468 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 272/561] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:56 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1756 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:56.911700 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-eb4b414e-023b-4a79-88d3-584a59d0b005 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:56.919721 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-eb4b414e-023b-4a79-88d3-584a59d0b005 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee" status: 200 len: 1300 microversion: 2.1 time: 0.117527 Jun 30 10:04:56.920427 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 290/562] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:56 2022] GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee => generated 1300 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:04:57.336304 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-8368f777-17dd-4c2b-bd51-3d41d1f06246 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:57.337258 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-8368f777-17dd-4c2b-bd51-3d41d1f06246 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:57.345865 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8368f777-17dd-4c2b-bd51-3d41d1f06246 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:57.346308 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8368f777-17dd-4c2b-bd51-3d41d1f06246 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:57.347051 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8368f777-17dd-4c2b-bd51-3d41d1f06246 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:57.347472 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8368f777-17dd-4c2b-bd51-3d41d1f06246 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:57.564406 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-8368f777-17dd-4c2b-bd51-3d41d1f06246 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:57.572787 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-8368f777-17dd-4c2b-bd51-3d41d1f06246 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1736 microversion: 2.1 time: 0.242988 Jun 30 10:04:57.573355 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 273/563] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:57 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1736 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:57.868805 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ae377a10-13db-454e-b38d-245a2875bd72 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:57.869386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-ae377a10-13db-454e-b38d-245a2875bd72 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:57.876436 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ae377a10-13db-454e-b38d-245a2875bd72 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:57.877144 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ae377a10-13db-454e-b38d-245a2875bd72 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:57.877955 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ae377a10-13db-454e-b38d-245a2875bd72 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:57.878570 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ae377a10-13db-454e-b38d-245a2875bd72 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:57.937019 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-bee5b9e9-be33-4968-9f3b-c8c2ae0afa67 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:57.937668 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-bee5b9e9-be33-4968-9f3b-c8c2ae0afa67 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 83e934b3-db47-4ab2-a42e-252f5edb6cee] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:57.947472 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-bee5b9e9-be33-4968-9f3b-c8c2ae0afa67 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:57.947962 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-bee5b9e9-be33-4968-9f3b-c8c2ae0afa67 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:57.948738 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-bee5b9e9-be33-4968-9f3b-c8c2ae0afa67 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:57.949192 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-bee5b9e9-be33-4968-9f3b-c8c2ae0afa67 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:58.201192 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ae377a10-13db-454e-b38d-245a2875bd72 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:58.209979 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ae377a10-13db-454e-b38d-245a2875bd72 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1756 microversion: 2.1 time: 0.345349 Jun 30 10:04:58.210796 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 291/564] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:57 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1756 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:58.244628 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-bee5b9e9-be33-4968-9f3b-c8c2ae0afa67 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:58.252858 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-bee5b9e9-be33-4968-9f3b-c8c2ae0afa67 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee" status: 200 len: 1365 microversion: 2.1 time: 0.319639 Jun 30 10:04:58.253428 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 274/565] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:57 2022] GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee => generated 1365 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:04:58.590321 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-89ba8176-39ef-43cb-8aaf-d27755232f22 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:58.591034 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-89ba8176-39ef-43cb-8aaf-d27755232f22 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:58.597250 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-89ba8176-39ef-43cb-8aaf-d27755232f22 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:58.597768 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-89ba8176-39ef-43cb-8aaf-d27755232f22 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:58.598600 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-89ba8176-39ef-43cb-8aaf-d27755232f22 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:58.599093 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-89ba8176-39ef-43cb-8aaf-d27755232f22 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:58.812203 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-89ba8176-39ef-43cb-8aaf-d27755232f22 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:58.822223 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-89ba8176-39ef-43cb-8aaf-d27755232f22 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1736 microversion: 2.1 time: 0.235073 Jun 30 10:04:58.828890 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 292/566] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:58 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1736 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:58.932219 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [req-1291dccb-9676-444e-ac2c-c356c8287b69 req-d6e0c86b-e787-4ca1-bf17-2c802c938b16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83e934b3-db47-4ab2-a42e-252f5edb6cee", "tag": "2207973a-d23f-47ca-95f4-cd7d1c8e63af"}]} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:04:58.947334 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-1291dccb-9676-444e-ac2c-c356c8287b69 req-d6e0c86b-e787-4ca1-bf17-2c802c938b16 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:58.948498 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-1291dccb-9676-444e-ac2c-c356c8287b69 req-d6e0c86b-e787-4ca1-bf17-2c802c938b16 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:58.963652 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.compute.server_external_events [req-1291dccb-9676-444e-ac2c-c356c8287b69 req-d6e0c86b-e787-4ca1-bf17-2c802c938b16 service nova] Creating event network-changed:2207973a-d23f-47ca-95f4-cd7d1c8e63af for instance 83e934b3-db47-4ab2-a42e-252f5edb6cee on hv-cinder-84330 Jun 30 10:04:58.969833 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [req-1291dccb-9676-444e-ac2c-c356c8287b69 req-d6e0c86b-e787-4ca1-bf17-2c802c938b16 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042294 Jun 30 10:04:58.970452 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 275/567] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:04:59.228131 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-37cdedd3-0115-4bcb-bcae-b535b687a366 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:59.228735 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-37cdedd3-0115-4bcb-bcae-b535b687a366 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:59.235844 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-37cdedd3-0115-4bcb-bcae-b535b687a366 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:59.236325 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-37cdedd3-0115-4bcb-bcae-b535b687a366 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:59.237073 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-37cdedd3-0115-4bcb-bcae-b535b687a366 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:59.237502 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-37cdedd3-0115-4bcb-bcae-b535b687a366 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:59.270168 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-58c18e7f-dc20-4c15-9278-9af602957f74 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:59.271167 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-58c18e7f-dc20-4c15-9278-9af602957f74 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 83e934b3-db47-4ab2-a42e-252f5edb6cee] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:59.277753 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-58c18e7f-dc20-4c15-9278-9af602957f74 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:59.278199 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-58c18e7f-dc20-4c15-9278-9af602957f74 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:59.279156 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-58c18e7f-dc20-4c15-9278-9af602957f74 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:59.280203 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-58c18e7f-dc20-4c15-9278-9af602957f74 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:59.430873 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-37cdedd3-0115-4bcb-bcae-b535b687a366 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:59.442355 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-37cdedd3-0115-4bcb-bcae-b535b687a366 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1756 microversion: 2.1 time: 0.217872 Jun 30 10:04:59.443287 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 293/568] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:59 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1756 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:59.460677 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-58c18e7f-dc20-4c15-9278-9af602957f74 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:59.470079 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-58c18e7f-dc20-4c15-9278-9af602957f74 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee" status: 200 len: 1365 microversion: 2.1 time: 0.203758 Jun 30 10:04:59.470765 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 276/569] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:59 2022] GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee => generated 1365 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:04:59.842108 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-5f647c54-aab8-439a-a92f-81e89ce4c4aa tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:04:59.842731 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-5f647c54-aab8-439a-a92f-81e89ce4c4aa tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:04:59.849730 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5f647c54-aab8-439a-a92f-81e89ce4c4aa tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:59.850185 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5f647c54-aab8-439a-a92f-81e89ce4c4aa tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:59.850950 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5f647c54-aab8-439a-a92f-81e89ce4c4aa tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:04:59.851386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5f647c54-aab8-439a-a92f-81e89ce4c4aa tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:04:59.983673 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-5f647c54-aab8-439a-a92f-81e89ce4c4aa tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:04:59.991787 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-5f647c54-aab8-439a-a92f-81e89ce4c4aa tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1736 microversion: 2.1 time: 0.156235 Jun 30 10:04:59.992393 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 294/570] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:04:59 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:05:00.463023 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-870be332-ac8f-4ec6-91ea-4f50cdcd8c65 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:00.463604 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-870be332-ac8f-4ec6-91ea-4f50cdcd8c65 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:00.471194 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-870be332-ac8f-4ec6-91ea-4f50cdcd8c65 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:00.471634 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-870be332-ac8f-4ec6-91ea-4f50cdcd8c65 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:00.472419 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-870be332-ac8f-4ec6-91ea-4f50cdcd8c65 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:00.472841 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-870be332-ac8f-4ec6-91ea-4f50cdcd8c65 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:00.490338 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-60d0d8f9-1e7f-483c-9230-b6eadb2f6d0f tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:00.490941 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-60d0d8f9-1e7f-483c-9230-b6eadb2f6d0f tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 83e934b3-db47-4ab2-a42e-252f5edb6cee] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:00.497996 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-60d0d8f9-1e7f-483c-9230-b6eadb2f6d0f tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:00.498441 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-60d0d8f9-1e7f-483c-9230-b6eadb2f6d0f tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:00.499195 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-60d0d8f9-1e7f-483c-9230-b6eadb2f6d0f tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:00.499629 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-60d0d8f9-1e7f-483c-9230-b6eadb2f6d0f tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:00.684906 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-60d0d8f9-1e7f-483c-9230-b6eadb2f6d0f tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:00.690571 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-870be332-ac8f-4ec6-91ea-4f50cdcd8c65 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:00.693213 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-60d0d8f9-1e7f-483c-9230-b6eadb2f6d0f tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee" status: 200 len: 1365 microversion: 2.1 time: 0.206753 Jun 30 10:05:00.693786 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 295/571] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:00 2022] GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee => generated 1365 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:05:00.699038 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-870be332-ac8f-4ec6-91ea-4f50cdcd8c65 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1756 microversion: 2.1 time: 0.240312 Jun 30 10:05:00.699587 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 277/572] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:00 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1756 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:05:01.009647 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-cd9d08b2-b202-4764-afca-2efee6128c93 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:01.010269 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-cd9d08b2-b202-4764-afca-2efee6128c93 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:01.016718 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cd9d08b2-b202-4764-afca-2efee6128c93 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:01.017157 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cd9d08b2-b202-4764-afca-2efee6128c93 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:01.017900 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cd9d08b2-b202-4764-afca-2efee6128c93 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:01.018319 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cd9d08b2-b202-4764-afca-2efee6128c93 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:01.164609 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-cd9d08b2-b202-4764-afca-2efee6128c93 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:01.172936 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-cd9d08b2-b202-4764-afca-2efee6128c93 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1736 microversion: 2.1 time: 0.167169 Jun 30 10:05:01.173493 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 296/573] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:01 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:05:01.713801 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-b5cae893-2f7b-465e-a91a-9e12f3b0bce6 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:01.714728 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-b5cae893-2f7b-465e-a91a-9e12f3b0bce6 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 83e934b3-db47-4ab2-a42e-252f5edb6cee] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:01.723207 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ee2df4b6-fe80-40f5-ad5e-90e78b50df0b tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:01.724026 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-ee2df4b6-fe80-40f5-ad5e-90e78b50df0b tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:01.724863 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b5cae893-2f7b-465e-a91a-9e12f3b0bce6 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:01.725521 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b5cae893-2f7b-465e-a91a-9e12f3b0bce6 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:01.726692 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b5cae893-2f7b-465e-a91a-9e12f3b0bce6 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:01.727314 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b5cae893-2f7b-465e-a91a-9e12f3b0bce6 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:01.733707 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ee2df4b6-fe80-40f5-ad5e-90e78b50df0b tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:01.734115 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ee2df4b6-fe80-40f5-ad5e-90e78b50df0b tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:01.734888 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ee2df4b6-fe80-40f5-ad5e-90e78b50df0b tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:01.735307 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ee2df4b6-fe80-40f5-ad5e-90e78b50df0b tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:01.934922 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-b5cae893-2f7b-465e-a91a-9e12f3b0bce6 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:01.943463 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-b5cae893-2f7b-465e-a91a-9e12f3b0bce6 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee" status: 200 len: 1365 microversion: 2.1 time: 0.236327 Jun 30 10:05:01.944096 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 278/574] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:01 2022] GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee => generated 1365 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:05:01.950092 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ee2df4b6-fe80-40f5-ad5e-90e78b50df0b tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:01.958766 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ee2df4b6-fe80-40f5-ad5e-90e78b50df0b tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1756 microversion: 2.1 time: 0.241654 Jun 30 10:05:01.959354 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 297/575] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:01 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1756 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:05:02.191373 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-f7b17c2e-1e4a-4fb9-8ca4-d2f7d6d5516d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:02.191528 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-f7b17c2e-1e4a-4fb9-8ca4-d2f7d6d5516d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:02.197942 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-f7b17c2e-1e4a-4fb9-8ca4-d2f7d6d5516d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:02.198394 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-f7b17c2e-1e4a-4fb9-8ca4-d2f7d6d5516d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:02.199165 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-f7b17c2e-1e4a-4fb9-8ca4-d2f7d6d5516d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:02.199588 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-f7b17c2e-1e4a-4fb9-8ca4-d2f7d6d5516d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:02.398458 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-f7b17c2e-1e4a-4fb9-8ca4-d2f7d6d5516d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:02.406781 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-f7b17c2e-1e4a-4fb9-8ca4-d2f7d6d5516d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1736 microversion: 2.1 time: 0.220277 Jun 30 10:05:02.407354 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 279/576] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:02 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:05:02.964124 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-86cce966-f8d4-4e04-84f2-b166694224b1 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:02.965092 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-86cce966-f8d4-4e04-84f2-b166694224b1 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 83e934b3-db47-4ab2-a42e-252f5edb6cee] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:02.972932 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-86cce966-f8d4-4e04-84f2-b166694224b1 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:02.973377 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-86cce966-f8d4-4e04-84f2-b166694224b1 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:02.974132 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-86cce966-f8d4-4e04-84f2-b166694224b1 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:02.974558 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-86cce966-f8d4-4e04-84f2-b166694224b1 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:02.977164 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-1d70ecc3-8c50-4140-ae59-64bbb75c6715 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:02.977764 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-1d70ecc3-8c50-4140-ae59-64bbb75c6715 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:02.984048 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1d70ecc3-8c50-4140-ae59-64bbb75c6715 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:02.984495 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1d70ecc3-8c50-4140-ae59-64bbb75c6715 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:02.985243 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1d70ecc3-8c50-4140-ae59-64bbb75c6715 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:02.985681 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1d70ecc3-8c50-4140-ae59-64bbb75c6715 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:03.174036 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-86cce966-f8d4-4e04-84f2-b166694224b1 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:03.188671 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-86cce966-f8d4-4e04-84f2-b166694224b1 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee" status: 200 len: 1365 microversion: 2.1 time: 0.230833 Jun 30 10:05:03.189356 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 298/577] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:02 2022] GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee => generated 1365 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:05:03.211034 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-1d70ecc3-8c50-4140-ae59-64bbb75c6715 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:03.219787 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-1d70ecc3-8c50-4140-ae59-64bbb75c6715 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1756 microversion: 2.1 time: 0.246966 Jun 30 10:05:03.229258 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 280/578] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:02 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1756 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:05:03.428290 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f6050601-7b9f-4af8-807c-667d3f3c430e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:03.429411 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f6050601-7b9f-4af8-807c-667d3f3c430e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:03.440849 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f6050601-7b9f-4af8-807c-667d3f3c430e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:03.441591 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f6050601-7b9f-4af8-807c-667d3f3c430e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:03.442843 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f6050601-7b9f-4af8-807c-667d3f3c430e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:03.443570 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f6050601-7b9f-4af8-807c-667d3f3c430e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:03.596695 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f6050601-7b9f-4af8-807c-667d3f3c430e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:03.606668 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f6050601-7b9f-4af8-807c-667d3f3c430e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1736 microversion: 2.1 time: 0.184612 Jun 30 10:05:03.607314 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 299/579] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:03 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1736 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:05:04.206488 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-072ca30a-e02e-4f8f-adef-b8c6c64b801e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:04.207043 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-072ca30a-e02e-4f8f-adef-b8c6c64b801e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 83e934b3-db47-4ab2-a42e-252f5edb6cee] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:04.214068 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-072ca30a-e02e-4f8f-adef-b8c6c64b801e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:04.214506 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-072ca30a-e02e-4f8f-adef-b8c6c64b801e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:04.215293 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-072ca30a-e02e-4f8f-adef-b8c6c64b801e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:04.215746 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-072ca30a-e02e-4f8f-adef-b8c6c64b801e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:04.236205 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e9aef6b0-6959-43cd-bbc6-9221fdd31dcd tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:04.236835 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-e9aef6b0-6959-43cd-bbc6-9221fdd31dcd tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:04.243841 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e9aef6b0-6959-43cd-bbc6-9221fdd31dcd tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:04.244326 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e9aef6b0-6959-43cd-bbc6-9221fdd31dcd tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:04.245082 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e9aef6b0-6959-43cd-bbc6-9221fdd31dcd tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:04.245728 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e9aef6b0-6959-43cd-bbc6-9221fdd31dcd tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:04.415047 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-072ca30a-e02e-4f8f-adef-b8c6c64b801e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:04.422884 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-072ca30a-e02e-4f8f-adef-b8c6c64b801e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee" status: 200 len: 1365 microversion: 2.1 time: 0.220249 Jun 30 10:05:04.423456 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 281/580] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:04 2022] GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:05:04.433114 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e9aef6b0-6959-43cd-bbc6-9221fdd31dcd tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:04.442421 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-e9aef6b0-6959-43cd-bbc6-9221fdd31dcd tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1756 microversion: 2.1 time: 0.210102 Jun 30 10:05:04.442980 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 300/581] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:04 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1756 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:05:04.633164 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-33fb2e6a-6ae4-42e2-a48f-61207ccc61e7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:04.634130 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-33fb2e6a-6ae4-42e2-a48f-61207ccc61e7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:04.642320 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-33fb2e6a-6ae4-42e2-a48f-61207ccc61e7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:04.642763 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-33fb2e6a-6ae4-42e2-a48f-61207ccc61e7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:04.643518 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-33fb2e6a-6ae4-42e2-a48f-61207ccc61e7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:04.643977 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-33fb2e6a-6ae4-42e2-a48f-61207ccc61e7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:04.777241 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-33fb2e6a-6ae4-42e2-a48f-61207ccc61e7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:04.788399 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-33fb2e6a-6ae4-42e2-a48f-61207ccc61e7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1736 microversion: 2.1 time: 0.161353 Jun 30 10:05:04.789157 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 282/582] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:04 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:05:05.442378 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-23bbf6cc-ee35-46bd-a15f-8d6042825984 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:05.442996 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-23bbf6cc-ee35-46bd-a15f-8d6042825984 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 83e934b3-db47-4ab2-a42e-252f5edb6cee] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:05.450054 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-23bbf6cc-ee35-46bd-a15f-8d6042825984 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:05.450623 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-23bbf6cc-ee35-46bd-a15f-8d6042825984 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:05.452197 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-23bbf6cc-ee35-46bd-a15f-8d6042825984 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:05.452609 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-23bbf6cc-ee35-46bd-a15f-8d6042825984 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:05.460567 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-dab13162-0234-421c-8e16-6433353cbd2c tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:05.461191 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-dab13162-0234-421c-8e16-6433353cbd2c tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:05.468528 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-dab13162-0234-421c-8e16-6433353cbd2c tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:05.468978 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-dab13162-0234-421c-8e16-6433353cbd2c tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:05.469897 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-dab13162-0234-421c-8e16-6433353cbd2c tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:05.470708 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-dab13162-0234-421c-8e16-6433353cbd2c tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:05.638062 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=2 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:05:05.657257 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=10 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:05:05.668175 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-23bbf6cc-ee35-46bd-a15f-8d6042825984 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:05.673659 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-dab13162-0234-421c-8e16-6433353cbd2c tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:05.676131 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-23bbf6cc-ee35-46bd-a15f-8d6042825984 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee" status: 200 len: 1365 microversion: 2.1 time: 0.238462 Jun 30 10:05:05.676887 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 301/583] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:05 2022] GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee => generated 1365 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:05:05.689737 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-dab13162-0234-421c-8e16-6433353cbd2c tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1756 microversion: 2.1 time: 0.233261 Jun 30 10:05:05.690428 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 283/584] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:05 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1756 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:05:05.810525 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-743fdc03-14c8-4361-b3c1-1e2ca1787f0d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:05.811232 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-743fdc03-14c8-4361-b3c1-1e2ca1787f0d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:05.818946 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-743fdc03-14c8-4361-b3c1-1e2ca1787f0d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:05.819385 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-743fdc03-14c8-4361-b3c1-1e2ca1787f0d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:05.820232 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-743fdc03-14c8-4361-b3c1-1e2ca1787f0d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:05.820651 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-743fdc03-14c8-4361-b3c1-1e2ca1787f0d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:05.968983 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-743fdc03-14c8-4361-b3c1-1e2ca1787f0d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:05.971215 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=100 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:05:05.981466 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-743fdc03-14c8-4361-b3c1-1e2ca1787f0d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1736 microversion: 2.1 time: 0.177040 Jun 30 10:05:05.982125 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 302/585] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:05 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:05:06.694330 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-18c00c3c-c72d-411f-8d9b-b963c3751060 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:06.694928 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-18c00c3c-c72d-411f-8d9b-b963c3751060 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 83e934b3-db47-4ab2-a42e-252f5edb6cee] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:06.696902 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell0:SELECT=2 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:05:06.702865 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-18c00c3c-c72d-411f-8d9b-b963c3751060 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:06.703308 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-18c00c3c-c72d-411f-8d9b-b963c3751060 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:06.704106 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-18c00c3c-c72d-411f-8d9b-b963c3751060 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:06.704540 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-18c00c3c-c72d-411f-8d9b-b963c3751060 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:06.710607 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-d547c302-307d-44c4-987c-e0c72ace46d2 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:06.711199 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-d547c302-307d-44c4-987c-e0c72ace46d2 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:06.718689 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d547c302-307d-44c4-987c-e0c72ace46d2 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:06.719127 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d547c302-307d-44c4-987c-e0c72ace46d2 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:06.719906 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d547c302-307d-44c4-987c-e0c72ace46d2 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:06.720331 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d547c302-307d-44c4-987c-e0c72ace46d2 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:06.925485 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-18c00c3c-c72d-411f-8d9b-b963c3751060 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:06.933258 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-18c00c3c-c72d-411f-8d9b-b963c3751060 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee" status: 200 len: 1365 microversion: 2.1 time: 0.242828 Jun 30 10:05:06.934000 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 284/586] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:06 2022] GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee => generated 1365 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:05:06.997803 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-d547c302-307d-44c4-987c-e0c72ace46d2 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:06.998309 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-a5bc5d7b-a96e-496b-be56-d2334bfae787 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:06.998917 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-a5bc5d7b-a96e-496b-be56-d2334bfae787 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:07.005390 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a5bc5d7b-a96e-496b-be56-d2334bfae787 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:07.005832 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a5bc5d7b-a96e-496b-be56-d2334bfae787 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:07.006331 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-d547c302-307d-44c4-987c-e0c72ace46d2 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1759 microversion: 2.1 time: 0.299617 Jun 30 10:05:07.006571 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a5bc5d7b-a96e-496b-be56-d2334bfae787 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:07.007009 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a5bc5d7b-a96e-496b-be56-d2334bfae787 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:07.011940 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 303/587] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:06 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1759 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:05:07.162511 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-93d538dd-5528-4de4-a50b-6d64f5892ce0 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:07.163301 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-93d538dd-5528-4de4-a50b-6d64f5892ce0 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:07.170130 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-93d538dd-5528-4de4-a50b-6d64f5892ce0 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:07.170570 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-93d538dd-5528-4de4-a50b-6d64f5892ce0 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:07.171320 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-93d538dd-5528-4de4-a50b-6d64f5892ce0 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:07.171741 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-93d538dd-5528-4de4-a50b-6d64f5892ce0 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:07.202127 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-93d538dd-5528-4de4-a50b-6d64f5892ce0 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d/os-volume_attachments/69b676e6-2807-4a21-a60a-9c0ebb23b487" status: 200 len: 194 microversion: 2.20 time: 0.043491 Jun 30 10:05:07.202654 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 304/588] 10.222.0.16 () {60 vars in 1453 bytes} [Thu Jun 30 10:05:07 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d/os-volume_attachments/69b676e6-2807-4a21-a60a-9c0ebb23b487 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 10:05:07.234410 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-a5bc5d7b-a96e-496b-be56-d2334bfae787 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:07.237267 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell1:SELECT=100 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:05:07.244835 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-a5bc5d7b-a96e-496b-be56-d2334bfae787 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1736 microversion: 2.1 time: 0.250515 Jun 30 10:05:07.245395 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 285/589] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:06 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1736 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:05:07.268142 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-4771ea55-ab50-459b-adb2-250483450e21 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:07.268730 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-4771ea55-ab50-459b-adb2-250483450e21 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:07.274893 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4771ea55-ab50-459b-adb2-250483450e21 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:07.275408 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4771ea55-ab50-459b-adb2-250483450e21 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:07.276273 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4771ea55-ab50-459b-adb2-250483450e21 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:07.276771 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4771ea55-ab50-459b-adb2-250483450e21 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:07.365155 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.objects.instance [None req-4771ea55-ab50-459b-adb2-250483450e21 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lazy-loading 'services' on Instance uuid 8c15c69f-e851-41aa-9f31-0e897b2f302d {{(pid=117846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:05:07.447105 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-4771ea55-ab50-459b-adb2-250483450e21 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d/os-volume_attachments/69b676e6-2807-4a21-a60a-9c0ebb23b487" status: 202 len: 0 microversion: 2.20 time: 0.182936 Jun 30 10:05:07.447765 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 305/590] 10.222.0.16 () {60 vars in 1456 bytes} [Thu Jun 30 10:05:07 2022] DELETE /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d/os-volume_attachments/69b676e6-2807-4a21-a60a-9c0ebb23b487 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 30 10:05:07.457285 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-cfa957f8-56a3-44da-98c9-08c2e57c645b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:07.458199 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-cfa957f8-56a3-44da-98c9-08c2e57c645b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:07.466130 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-cfa957f8-56a3-44da-98c9-08c2e57c645b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:07.466651 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-cfa957f8-56a3-44da-98c9-08c2e57c645b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:07.467424 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-cfa957f8-56a3-44da-98c9-08c2e57c645b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:07.467848 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-cfa957f8-56a3-44da-98c9-08c2e57c645b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:07.506570 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-cfa957f8-56a3-44da-98c9-08c2e57c645b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053993 Jun 30 10:05:07.507150 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 286/591] 10.222.0.16 () {60 vars in 1342 bytes} [Thu Jun 30 10:05:07 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 10:05:07.730223 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-879a0895-97fa-4744-a581-f04a4278e302 req-696a4a14-365b-4a2d-9980-d3aff3541451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83e934b3-db47-4ab2-a42e-252f5edb6cee", "name": "network-vif-plugged", "status": "completed", "tag": "2207973a-d23f-47ca-95f4-cd7d1c8e63af"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:05:07.739109 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-879a0895-97fa-4744-a581-f04a4278e302 req-696a4a14-365b-4a2d-9980-d3aff3541451 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:07.739548 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-879a0895-97fa-4744-a581-f04a4278e302 req-696a4a14-365b-4a2d-9980-d3aff3541451 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:07.752475 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-879a0895-97fa-4744-a581-f04a4278e302 req-696a4a14-365b-4a2d-9980-d3aff3541451 service nova] Creating event network-vif-plugged:2207973a-d23f-47ca-95f4-cd7d1c8e63af for instance 83e934b3-db47-4ab2-a42e-252f5edb6cee on hv-cinder-84330 Jun 30 10:05:07.757366 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-879a0895-97fa-4744-a581-f04a4278e302 req-696a4a14-365b-4a2d-9980-d3aff3541451 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031629 Jun 30 10:05:07.757952 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 306/592] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:05:07.950884 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-93770eb6-b0fa-473a-aed9-3cbe9e0a83c8 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:07.951647 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-93770eb6-b0fa-473a-aed9-3cbe9e0a83c8 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 83e934b3-db47-4ab2-a42e-252f5edb6cee] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:07.959219 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-93770eb6-b0fa-473a-aed9-3cbe9e0a83c8 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:07.959430 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-93770eb6-b0fa-473a-aed9-3cbe9e0a83c8 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:07.960334 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-93770eb6-b0fa-473a-aed9-3cbe9e0a83c8 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:07.960737 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-93770eb6-b0fa-473a-aed9-3cbe9e0a83c8 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:08.099672 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-93770eb6-b0fa-473a-aed9-3cbe9e0a83c8 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:08.108456 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-93770eb6-b0fa-473a-aed9-3cbe9e0a83c8 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee" status: 200 len: 1365 microversion: 2.1 time: 0.161534 Jun 30 10:05:08.108997 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 287/593] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:07 2022] GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:05:08.265659 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-46404edf-ad0b-46cd-901a-110ab4275dd0 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:08.266720 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-46404edf-ad0b-46cd-901a-110ab4275dd0 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:08.276416 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-46404edf-ad0b-46cd-901a-110ab4275dd0 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:08.276966 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-46404edf-ad0b-46cd-901a-110ab4275dd0 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:08.278087 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-46404edf-ad0b-46cd-901a-110ab4275dd0 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:08.278659 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-46404edf-ad0b-46cd-901a-110ab4275dd0 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:08.413127 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-46404edf-ad0b-46cd-901a-110ab4275dd0 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:08.422103 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-46404edf-ad0b-46cd-901a-110ab4275dd0 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1736 microversion: 2.1 time: 0.163602 Jun 30 10:05:08.422698 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 307/594] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:08 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:05:08.519268 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-e9de2495-ae42-45bf-8b45-ed6d99686272 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:08.520242 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-e9de2495-ae42-45bf-8b45-ed6d99686272 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:08.528970 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e9de2495-ae42-45bf-8b45-ed6d99686272 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:08.529952 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e9de2495-ae42-45bf-8b45-ed6d99686272 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:08.530817 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e9de2495-ae42-45bf-8b45-ed6d99686272 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:08.531521 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e9de2495-ae42-45bf-8b45-ed6d99686272 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:08.565209 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-e9de2495-ae42-45bf-8b45-ed6d99686272 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050197 Jun 30 10:05:08.565770 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 288/595] 10.222.0.16 () {60 vars in 1342 bytes} [Thu Jun 30 10:05:08 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:05:08.623436 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-077a9fbd-42fc-4f4d-86bc-5f3b1ef1b3b9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:08.623933 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-077a9fbd-42fc-4f4d-86bc-5f3b1ef1b3b9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:08.630034 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-077a9fbd-42fc-4f4d-86bc-5f3b1ef1b3b9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:08.630463 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-077a9fbd-42fc-4f4d-86bc-5f3b1ef1b3b9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:08.631181 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-077a9fbd-42fc-4f4d-86bc-5f3b1ef1b3b9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:08.631621 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-077a9fbd-42fc-4f4d-86bc-5f3b1ef1b3b9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:08.657236 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-077a9fbd-42fc-4f4d-86bc-5f3b1ef1b3b9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Going to try to terminate instance {{(pid=117846) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 10:05:08.746271 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-077a9fbd-42fc-4f4d-86bc-5f3b1ef1b3b9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 204 len: 0 microversion: 2.20 time: 0.126819 Jun 30 10:05:08.747012 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 308/596] 10.222.0.16 () {60 vars in 1279 bytes} [Thu Jun 30 10:05:08 2022] DELETE /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 30 10:05:08.756466 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-584e3fdb-f3e2-46be-b518-652495172a6e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:08.757117 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-584e3fdb-f3e2-46be-b518-652495172a6e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:08.763650 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-584e3fdb-f3e2-46be-b518-652495172a6e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:08.764163 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-584e3fdb-f3e2-46be-b518-652495172a6e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:08.764908 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-584e3fdb-f3e2-46be-b518-652495172a6e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:08.765438 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-584e3fdb-f3e2-46be-b518-652495172a6e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:08.901986 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-584e3fdb-f3e2-46be-b518-652495172a6e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:08.910410 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-584e3fdb-f3e2-46be-b518-652495172a6e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:08.911902 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-584e3fdb-f3e2-46be-b518-652495172a6e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:08.913071 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-584e3fdb-f3e2-46be-b518-652495172a6e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1724 microversion: 2.20 time: 0.160868 Jun 30 10:05:08.913629 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 289/597] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:05:08 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:05:09.130110 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f0ec3aec-ada8-447f-8b90-d9d5be562d21 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:09.131295 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f0ec3aec-ada8-447f-8b90-d9d5be562d21 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 83e934b3-db47-4ab2-a42e-252f5edb6cee] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:09.140585 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f0ec3aec-ada8-447f-8b90-d9d5be562d21 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:09.141024 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f0ec3aec-ada8-447f-8b90-d9d5be562d21 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:09.141791 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f0ec3aec-ada8-447f-8b90-d9d5be562d21 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:09.142218 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f0ec3aec-ada8-447f-8b90-d9d5be562d21 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:09.281907 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f0ec3aec-ada8-447f-8b90-d9d5be562d21 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:09.289767 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f0ec3aec-ada8-447f-8b90-d9d5be562d21 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee" status: 200 len: 1365 microversion: 2.1 time: 0.166722 Jun 30 10:05:09.290321 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 309/598] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:09 2022] GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:05:09.441914 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-69f426bc-bb56-4229-a63a-52122f63dbda tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:09.442651 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-69f426bc-bb56-4229-a63a-52122f63dbda tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:09.451290 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-69f426bc-bb56-4229-a63a-52122f63dbda tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:09.452144 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-69f426bc-bb56-4229-a63a-52122f63dbda tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:09.453074 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-69f426bc-bb56-4229-a63a-52122f63dbda tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:09.453607 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-69f426bc-bb56-4229-a63a-52122f63dbda tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:09.605162 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-69f426bc-bb56-4229-a63a-52122f63dbda tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:09.614001 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-69f426bc-bb56-4229-a63a-52122f63dbda tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1736 microversion: 2.1 time: 0.177428 Jun 30 10:05:09.614566 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 290/599] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:09 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:05:09.934860 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-a6487548-bc24-4508-8063-467ab8f1714a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:09.936484 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-a6487548-bc24-4508-8063-467ab8f1714a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:09.952241 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a6487548-bc24-4508-8063-467ab8f1714a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:09.952702 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a6487548-bc24-4508-8063-467ab8f1714a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:09.953464 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a6487548-bc24-4508-8063-467ab8f1714a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:09.953892 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a6487548-bc24-4508-8063-467ab8f1714a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:10.094298 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-a6487548-bc24-4508-8063-467ab8f1714a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:10.107110 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-a6487548-bc24-4508-8063-467ab8f1714a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:10.108990 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-a6487548-bc24-4508-8063-467ab8f1714a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:10.110150 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-a6487548-bc24-4508-8063-467ab8f1714a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1724 microversion: 2.20 time: 0.182353 Jun 30 10:05:10.110714 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 310/600] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:05:09 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:05:10.308214 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-4e0f3714-d973-4c9c-827b-830656f95858 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:10.308918 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-4e0f3714-d973-4c9c-827b-830656f95858 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 83e934b3-db47-4ab2-a42e-252f5edb6cee] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:10.316205 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4e0f3714-d973-4c9c-827b-830656f95858 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:10.316639 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4e0f3714-d973-4c9c-827b-830656f95858 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:10.317381 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4e0f3714-d973-4c9c-827b-830656f95858 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:10.317805 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4e0f3714-d973-4c9c-827b-830656f95858 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:10.450522 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-4e0f3714-d973-4c9c-827b-830656f95858 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:10.469925 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-4e0f3714-d973-4c9c-827b-830656f95858 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee" status: 200 len: 1365 microversion: 2.1 time: 0.166218 Jun 30 10:05:10.470500 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 291/601] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:10 2022] GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:05:10.632356 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-3dde5ae3-02aa-4402-8aae-4d9dda444adf tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:10.632976 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-3dde5ae3-02aa-4402-8aae-4d9dda444adf tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:10.639561 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3dde5ae3-02aa-4402-8aae-4d9dda444adf tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:10.640024 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3dde5ae3-02aa-4402-8aae-4d9dda444adf tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:10.640768 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3dde5ae3-02aa-4402-8aae-4d9dda444adf tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:10.641200 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3dde5ae3-02aa-4402-8aae-4d9dda444adf tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:10.703124 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-b7581c29-4e1a-4fd6-8b97-74f915946418 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:10.703598 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-b7581c29-4e1a-4fd6-8b97-74f915946418 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 2270d4c1-54d0-468c-acc2-cc2dbc933058] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:10.709964 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b7581c29-4e1a-4fd6-8b97-74f915946418 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:10.710409 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b7581c29-4e1a-4fd6-8b97-74f915946418 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:10.711166 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b7581c29-4e1a-4fd6-8b97-74f915946418 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:10.711582 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b7581c29-4e1a-4fd6-8b97-74f915946418 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:10.778733 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-3dde5ae3-02aa-4402-8aae-4d9dda444adf tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:10.787288 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-3dde5ae3-02aa-4402-8aae-4d9dda444adf tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1736 microversion: 2.1 time: 0.158812 Jun 30 10:05:10.787861 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 311/602] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:10 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:05:10.792666 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.objects.instance [None req-b7581c29-4e1a-4fd6-8b97-74f915946418 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lazy-loading 'services' on Instance uuid 2270d4c1-54d0-468c-acc2-cc2dbc933058 {{(pid=117847) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:05:10.867220 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-b7581c29-4e1a-4fd6-8b97-74f915946418 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2270d4c1-54d0-468c-acc2-cc2dbc933058/os-volume_attachments/781ce365-6024-4312-8075-fbbf3724293b" status: 202 len: 0 microversion: 2.1 time: 0.168161 Jun 30 10:05:10.867821 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 292/603] 10.222.0.16 () {58 vars in 1415 bytes} [Thu Jun 30 10:05:10 2022] DELETE /compute/v2.1/servers/2270d4c1-54d0-468c-acc2-cc2dbc933058/os-volume_attachments/781ce365-6024-4312-8075-fbbf3724293b => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 30 10:05:11.132933 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-1732faad-57ac-4c06-86e4-d60a10400986 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:11.133963 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-1732faad-57ac-4c06-86e4-d60a10400986 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:11.145062 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1732faad-57ac-4c06-86e4-d60a10400986 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:11.145804 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1732faad-57ac-4c06-86e4-d60a10400986 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:11.147055 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1732faad-57ac-4c06-86e4-d60a10400986 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:11.147766 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1732faad-57ac-4c06-86e4-d60a10400986 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:11.294507 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-1732faad-57ac-4c06-86e4-d60a10400986 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:11.302701 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-1732faad-57ac-4c06-86e4-d60a10400986 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:11.304220 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-1732faad-57ac-4c06-86e4-d60a10400986 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:11.305596 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-1732faad-57ac-4c06-86e4-d60a10400986 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1724 microversion: 2.20 time: 0.179391 Jun 30 10:05:11.306486 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 312/604] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:05:11 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:05:11.487854 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-d1c40dcb-6500-479c-97e3-f1a3604ec35d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:11.488461 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-d1c40dcb-6500-479c-97e3-f1a3604ec35d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 83e934b3-db47-4ab2-a42e-252f5edb6cee] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:11.495151 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d1c40dcb-6500-479c-97e3-f1a3604ec35d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:11.495592 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d1c40dcb-6500-479c-97e3-f1a3604ec35d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:11.496382 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d1c40dcb-6500-479c-97e3-f1a3604ec35d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:11.496810 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d1c40dcb-6500-479c-97e3-f1a3604ec35d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:11.750565 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-d1c40dcb-6500-479c-97e3-f1a3604ec35d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:11.758605 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-d1c40dcb-6500-479c-97e3-f1a3604ec35d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee" status: 200 len: 1556 microversion: 2.1 time: 0.275577 Jun 30 10:05:11.759175 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 293/605] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:11 2022] GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee => generated 1556 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:05:11.777789 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-bd44ea16-ca83-42df-aae5-5057d9e536fc tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:11.778403 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-bd44ea16-ca83-42df-aae5-5057d9e536fc tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 83e934b3-db47-4ab2-a42e-252f5edb6cee] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:11.786122 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bd44ea16-ca83-42df-aae5-5057d9e536fc tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:11.786569 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bd44ea16-ca83-42df-aae5-5057d9e536fc tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:11.787340 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bd44ea16-ca83-42df-aae5-5057d9e536fc tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:11.787775 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bd44ea16-ca83-42df-aae5-5057d9e536fc tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:11.804976 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-d0a6064f-3a11-4dfe-84a9-09f97889f1da tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:11.805835 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-d0a6064f-3a11-4dfe-84a9-09f97889f1da tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:11.814474 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d0a6064f-3a11-4dfe-84a9-09f97889f1da tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:11.815562 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d0a6064f-3a11-4dfe-84a9-09f97889f1da tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:11.817122 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d0a6064f-3a11-4dfe-84a9-09f97889f1da tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:11.818067 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d0a6064f-3a11-4dfe-84a9-09f97889f1da tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:11.918965 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-bd44ea16-ca83-42df-aae5-5057d9e536fc tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.146828 Jun 30 10:05:11.919535 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 313/606] 10.222.0.16 () {58 vars in 1274 bytes} [Thu Jun 30 10:05:11 2022] GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee/os-interface => generated 285 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:05:12.072732 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-d0a6064f-3a11-4dfe-84a9-09f97889f1da tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:12.096756 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-d0a6064f-3a11-4dfe-84a9-09f97889f1da tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1736 microversion: 2.1 time: 0.296704 Jun 30 10:05:12.103719 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 294/607] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:11 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1736 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:05:12.326995 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-b1e6de69-08c0-4262-8f5b-30d925a487d7 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:12.328351 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-b1e6de69-08c0-4262-8f5b-30d925a487d7 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:12.340513 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b1e6de69-08c0-4262-8f5b-30d925a487d7 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:12.344213 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b1e6de69-08c0-4262-8f5b-30d925a487d7 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:12.345160 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b1e6de69-08c0-4262-8f5b-30d925a487d7 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:12.346432 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b1e6de69-08c0-4262-8f5b-30d925a487d7 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:12.367927 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [req-d6a92b20-5e7d-49ff-a862-f6f3e605b7c4 req-966bfaa2-3b0b-4afc-9194-2a3946ab7047 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c15c69f-e851-41aa-9f31-0e897b2f302d", "name": "network-vif-deleted", "tag": "c1be8ae5-cf30-4b83-be1b-6a94517a895b"}]} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:05:12.377063 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-d6a92b20-5e7d-49ff-a862-f6f3e605b7c4 req-966bfaa2-3b0b-4afc-9194-2a3946ab7047 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:12.377494 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-d6a92b20-5e7d-49ff-a862-f6f3e605b7c4 req-966bfaa2-3b0b-4afc-9194-2a3946ab7047 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:12.389684 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.compute.server_external_events [req-d6a92b20-5e7d-49ff-a862-f6f3e605b7c4 req-966bfaa2-3b0b-4afc-9194-2a3946ab7047 service nova] Creating event network-vif-deleted:c1be8ae5-cf30-4b83-be1b-6a94517a895b for instance 8c15c69f-e851-41aa-9f31-0e897b2f302d on hv-cinder-84330 Jun 30 10:05:12.395610 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [req-d6a92b20-5e7d-49ff-a862-f6f3e605b7c4 req-966bfaa2-3b0b-4afc-9194-2a3946ab7047 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031445 Jun 30 10:05:12.400506 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 295/608] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:05:12.466174 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-b1e6de69-08c0-4262-8f5b-30d925a487d7 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:12.477019 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-b1e6de69-08c0-4262-8f5b-30d925a487d7 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:12.478782 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-b1e6de69-08c0-4262-8f5b-30d925a487d7 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:12.480164 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-b1e6de69-08c0-4262-8f5b-30d925a487d7 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 200 len: 1656 microversion: 2.20 time: 0.158749 Jun 30 10:05:12.480991 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 314/609] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:05:12 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 1656 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:05:13.045082 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-ff1ba6d6-0cfb-4f9e-9ae7-21e9e42be3f3 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:13.045697 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-ff1ba6d6-0cfb-4f9e-9ae7-21e9e42be3f3 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 2270d4c1-54d0-468c-acc2-cc2dbc933058] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:13.052763 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ff1ba6d6-0cfb-4f9e-9ae7-21e9e42be3f3 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:13.053203 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ff1ba6d6-0cfb-4f9e-9ae7-21e9e42be3f3 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:13.053966 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ff1ba6d6-0cfb-4f9e-9ae7-21e9e42be3f3 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:13.054389 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ff1ba6d6-0cfb-4f9e-9ae7-21e9e42be3f3 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:13.081176 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-ff1ba6d6-0cfb-4f9e-9ae7-21e9e42be3f3 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 2270d4c1-54d0-468c-acc2-cc2dbc933058] Going to try to terminate instance {{(pid=117847) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 10:05:13.119363 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-021adfe0-5fdc-4039-a845-3c468168e45b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:13.120437 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-021adfe0-5fdc-4039-a845-3c468168e45b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:13.129232 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-021adfe0-5fdc-4039-a845-3c468168e45b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:13.129677 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-021adfe0-5fdc-4039-a845-3c468168e45b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:13.131104 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-021adfe0-5fdc-4039-a845-3c468168e45b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:13.132482 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-021adfe0-5fdc-4039-a845-3c468168e45b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:13.190653 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-ff1ba6d6-0cfb-4f9e-9ae7-21e9e42be3f3 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2270d4c1-54d0-468c-acc2-cc2dbc933058" status: 204 len: 0 microversion: 2.1 time: 0.147887 Jun 30 10:05:13.195068 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 296/610] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 10:05:13 2022] DELETE /compute/v2.1/servers/2270d4c1-54d0-468c-acc2-cc2dbc933058 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 10:05:13.201650 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-0b4ce1c3-6c22-46da-bcd8-2c051cd5de1b tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:13.202605 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-0b4ce1c3-6c22-46da-bcd8-2c051cd5de1b tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 2270d4c1-54d0-468c-acc2-cc2dbc933058] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:13.211763 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-0b4ce1c3-6c22-46da-bcd8-2c051cd5de1b tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:13.212530 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-0b4ce1c3-6c22-46da-bcd8-2c051cd5de1b tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:13.214327 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-0b4ce1c3-6c22-46da-bcd8-2c051cd5de1b tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:13.214945 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-0b4ce1c3-6c22-46da-bcd8-2c051cd5de1b tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:13.337876 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-021adfe0-5fdc-4039-a845-3c468168e45b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:13.346657 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-021adfe0-5fdc-4039-a845-3c468168e45b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1736 microversion: 2.1 time: 0.236346 Jun 30 10:05:13.347722 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 315/611] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:13 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1736 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:05:13.352386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-be8c7058-5db5-44dc-b97e-b2982852f5bd req-08735938-28c5-48ee-a772-f754f6ffae16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83e934b3-db47-4ab2-a42e-252f5edb6cee", "tag": "2207973a-d23f-47ca-95f4-cd7d1c8e63af"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:05:13.360689 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-be8c7058-5db5-44dc-b97e-b2982852f5bd req-08735938-28c5-48ee-a772-f754f6ffae16 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:13.361345 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-be8c7058-5db5-44dc-b97e-b2982852f5bd req-08735938-28c5-48ee-a772-f754f6ffae16 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:13.374253 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-be8c7058-5db5-44dc-b97e-b2982852f5bd req-08735938-28c5-48ee-a772-f754f6ffae16 service nova] Creating event network-changed:2207973a-d23f-47ca-95f4-cd7d1c8e63af for instance 83e934b3-db47-4ab2-a42e-252f5edb6cee on hv-cinder-84330 Jun 30 10:05:13.380155 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-be8c7058-5db5-44dc-b97e-b2982852f5bd req-08735938-28c5-48ee-a772-f754f6ffae16 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031212 Jun 30 10:05:13.380743 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 316/612] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:05:13.405931 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-0b4ce1c3-6c22-46da-bcd8-2c051cd5de1b tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:13.413827 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-0b4ce1c3-6c22-46da-bcd8-2c051cd5de1b tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/2270d4c1-54d0-468c-acc2-cc2dbc933058" status: 200 len: 1515 microversion: 2.1 time: 0.216955 Jun 30 10:05:13.417521 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 297/613] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:13 2022] GET /compute/v2.1/servers/2270d4c1-54d0-468c-acc2-cc2dbc933058 => generated 1515 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:05:13.500154 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-78677d7f-d066-40c9-892e-35e91375ca85 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:13.500987 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-78677d7f-d066-40c9-892e-35e91375ca85 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:13.507058 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-78677d7f-d066-40c9-892e-35e91375ca85 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:13.507497 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-78677d7f-d066-40c9-892e-35e91375ca85 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:13.508274 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-78677d7f-d066-40c9-892e-35e91375ca85 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:13.508698 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-78677d7f-d066-40c9-892e-35e91375ca85 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:13.522181 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-78677d7f-d066-40c9-892e-35e91375ca85 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] HTTP exception thrown: Instance 8c15c69f-e851-41aa-9f31-0e897b2f302d could not be found. Jun 30 10:05:13.523911 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-78677d7f-d066-40c9-892e-35e91375ca85 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Request method failure captured: Jun 30 10:05:13.523911 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: request: GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d HTTP/1.1 Jun 30 10:05:13.523911 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept: application/json Jun 30 10:05:13.523911 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jun 30 10:05:13.523911 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Connection: close Jun 30 10:05:13.523911 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jun 30 10:05:13.523911 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jun 30 10:05:13.523911 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Host: 10.222.0.16 Jun 30 10:05:13.523911 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jun 30 10:05:13.523911 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jun 30 10:05:13.523911 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABivXROIoqnqppB9zI4SGGx_HRdQgE7Jwf9Q6ABVFO3YF4MJt8iDX9wfl5tmMxCD4aat9DoHOoTi0hqY0qsxR5em_ul168kANlvYR5xftHD2l1FVttzhSs9WOvzMYZWfJBqz4dZiVTw_1W7hycu8WoACIg3wRJ5z1a8aJCL10ePGVb617k Jun 30 10:05:13.523911 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jun 30 10:05:13.523911 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jun 30 10:05:13.523911 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jun 30 10:05:13.523911 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jun 30 10:05:13.523911 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 10:05:13.523911 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jun 30 10:05:13.523911 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jun 30 10:05:13.523911 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Id: f43a6e910b6b47c09a859ac798bff5cd Jun 30 10:05:13.523911 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-869476907 Jun 30 10:05:13.523911 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Role: reader,member Jun 30 10:05:13.523911 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Roles: reader,member Jun 30 10:05:13.525340 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f43a6e910b6b47c09a859ac798bff5cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f43a6e910b6b47c09a859ac798bff5cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f43a6e910b6b47c09a859ac798bff5cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f43a6e910b6b47c09a859ac798bff5cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:05:13.525340 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-AttachVolumeShelveTestJSON-869476907 Jun 30 10:05:13.525340 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Id: f43a6e910b6b47c09a859ac798bff5cd Jun 30 10:05:13.525340 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-869476907 Jun 30 10:05:13.525340 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User: tempest-AttachVolumeShelveTestJSON-869476907-project Jun 30 10:05:13.525340 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jun 30 10:05:13.525340 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jun 30 10:05:13.525340 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Id: 4b1614d524d24ce486741b599268995a Jun 30 10:05:13.525340 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-AttachVolumeShelveTestJSON-869476907-project Jun 30 10:05:13.525340 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: method: > Jun 30 10:05:13.525340 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: exception: Instance 8c15c69f-e851-41aa-9f31-0e897b2f302d could not be found. Jun 30 10:05:13.525340 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: action_args: {'id': '8c15c69f-e851-41aa-9f31-0e897b2f302d'} Jun 30 10:05:13.527142 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:05:13.527142 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:05:13.527142 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:05:13.527142 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:05:13.527142 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:05:13.527142 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:05:13.527142 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:05:13.527142 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:05:13.527142 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:05:13.527142 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:05:13.527142 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c15c69f-e851-41aa-9f31-0e897b2f302d could not be found. Jun 30 10:05:13.527142 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:05:13.527142 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:05:13.527142 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:05:13.527142 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:05:13.527142 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:05:13.527142 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:05:13.527142 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:05:13.527142 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:05:13.527142 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:05:13.528632 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:05:13.528632 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:05:13.528632 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:05:13.528632 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:05:13.528632 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:05:13.528632 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:05:13.528632 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:05:13.528632 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c15c69f-e851-41aa-9f31-0e897b2f302d could not be found. Jun 30 10:05:13.528632 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:05:13.528632 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:05:13.528632 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:05:13.528632 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:05:13.528632 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:05:13.528632 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:05:13.528632 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:05:13.528632 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:05:13.528632 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c15c69f-e851-41aa-9f31-0e897b2f302d could not be found. Jun 30 10:05:13.528632 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:05:13.530759 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-78677d7f-d066-40c9-892e-35e91375ca85 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Returning 404 to user: Instance 8c15c69f-e851-41aa-9f31-0e897b2f302d could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:05:13.530759 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-78677d7f-d066-40c9-892e-35e91375ca85 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 404 len: 111 microversion: 2.20 time: 0.030101 Jun 30 10:05:13.530759 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 317/614] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:05:13 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 10:05:13.534172 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-5d60b2c6-0a1f-4c70-a293-a7a5d5a970bb tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '.version_select at 0x7fc222bf3550>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:13.554372 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-5d60b2c6-0a1f-4c70-a293-a7a5d5a970bb tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1616078124" status: 204 len: 0 microversion: 2.20 time: 0.023941 Jun 30 10:05:13.558554 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 298/615] 10.222.0.16 () {60 vars in 1261 bytes} [Thu Jun 30 10:05:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1616078124 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 30 10:05:14.246019 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-b9f00916-4882-4870-be84-c427a0271121 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Action: 'create', calling method: .version_select at 0x7fc22028a430>, body: {"keypair": {"name": "tempest-keypair-1770983562", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8HjJUbsvOnWty2a/+g/m9JyTcmqwggbScHKTAjpxCHrK0aiElNXEF8k6VSOMJkm3qHkrXdEzd2qyZKd1HahYvIy9ws5SXcQe1s43DqK+fkepr4TDg2VGbzASK0vkifGA=="}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:05:14.260942 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-b9f00916-4882-4870-be84-c427a0271121 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Getting quotas for project f43a6e910b6b47c09a859ac798bff5cd. Resources: {'key_pairs'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:05:14.265358 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-b9f00916-4882-4870-be84-c427a0271121 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Getting quotas for user 4b1614d524d24ce486741b599268995a and project f43a6e910b6b47c09a859ac798bff5cd. Resources: {'key_pairs'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:05:14.266897 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:05:14.292535 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-b9f00916-4882-4870-be84-c427a0271121 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.050453 Jun 30 10:05:14.293361 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 318/616] 10.222.0.16 () {62 vars in 1199 bytes} [Thu Jun 30 10:05:14 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 30 10:05:14.364712 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-e1f3e8f6-b08d-4fe8-9533-51d12233b265 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:14.365488 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-e1f3e8f6-b08d-4fe8-9533-51d12233b265 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:14.372251 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e1f3e8f6-b08d-4fe8-9533-51d12233b265 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:14.372556 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e1f3e8f6-b08d-4fe8-9533-51d12233b265 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:14.373401 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e1f3e8f6-b08d-4fe8-9533-51d12233b265 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:14.373775 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e1f3e8f6-b08d-4fe8-9533-51d12233b265 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:14.431152 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-22b545a6-6c25-4d26-8a5d-fc6e48b339ac tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:14.431763 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-22b545a6-6c25-4d26-8a5d-fc6e48b339ac tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 2270d4c1-54d0-468c-acc2-cc2dbc933058] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:14.438866 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-22b545a6-6c25-4d26-8a5d-fc6e48b339ac tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:14.439549 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-22b545a6-6c25-4d26-8a5d-fc6e48b339ac tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:14.440324 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-22b545a6-6c25-4d26-8a5d-fc6e48b339ac tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:14.440778 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-22b545a6-6c25-4d26-8a5d-fc6e48b339ac tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:14.630969 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-e1f3e8f6-b08d-4fe8-9533-51d12233b265 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:14.640881 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-e1f3e8f6-b08d-4fe8-9533-51d12233b265 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1736 microversion: 2.1 time: 0.280532 Jun 30 10:05:14.649908 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 299/617] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:14 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1736 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:05:14.664054 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-22b545a6-6c25-4d26-8a5d-fc6e48b339ac tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:14.671821 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-22b545a6-6c25-4d26-8a5d-fc6e48b339ac tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/2270d4c1-54d0-468c-acc2-cc2dbc933058" status: 200 len: 1515 microversion: 2.1 time: 0.245091 Jun 30 10:05:14.672421 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 319/618] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:14 2022] GET /compute/v2.1/servers/2270d4c1-54d0-468c-acc2-cc2dbc933058 => generated 1515 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:05:15.570070 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [req-e2c31ecf-7d94-4c11-a11a-f94b795ffe3b req-6af2d8fe-da68-4973-bf22-e90029ce8f45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2270d4c1-54d0-468c-acc2-cc2dbc933058", "name": "network-vif-deleted", "tag": "703ecae9-4d65-4a21-99c8-e614d4240eda"}]} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:05:15.593991 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-e2c31ecf-7d94-4c11-a11a-f94b795ffe3b req-6af2d8fe-da68-4973-bf22-e90029ce8f45 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:15.594768 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-e2c31ecf-7d94-4c11-a11a-f94b795ffe3b req-6af2d8fe-da68-4973-bf22-e90029ce8f45 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:15.607982 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.compute.server_external_events [req-e2c31ecf-7d94-4c11-a11a-f94b795ffe3b req-6af2d8fe-da68-4973-bf22-e90029ce8f45 service nova] Creating event network-vif-deleted:703ecae9-4d65-4a21-99c8-e614d4240eda for instance 2270d4c1-54d0-468c-acc2-cc2dbc933058 on hv-cinder-84330 Jun 30 10:05:15.613443 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [req-e2c31ecf-7d94-4c11-a11a-f94b795ffe3b req-6af2d8fe-da68-4973-bf22-e90029ce8f45 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050699 Jun 30 10:05:15.624024 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 300/619] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:05:15.658374 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f4b916fe-291c-4450-b5e8-f0a03ae9f5c3 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:15.658982 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f4b916fe-291c-4450-b5e8-f0a03ae9f5c3 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:15.665680 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f4b916fe-291c-4450-b5e8-f0a03ae9f5c3 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:15.666120 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f4b916fe-291c-4450-b5e8-f0a03ae9f5c3 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:15.666974 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f4b916fe-291c-4450-b5e8-f0a03ae9f5c3 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:15.667402 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f4b916fe-291c-4450-b5e8-f0a03ae9f5c3 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:15.687640 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-c94bdbce-71f2-482f-8c69-2434d299d77d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1661436682", "imageRef": "c9dccba6-70d7-4aa8-9b8f-9c88ef1af443", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "da9749f8-c5ef-4789-90a3-1ad249823d2e"}], "security_groups": [{"name": "tempest-securitygroup--704125031"}], "key_name": "tempest-keypair-1770983562", "user_data": "}} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:05:15.705608 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:05:15.837156 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.network.neutron [None req-c94bdbce-71f2-482f-8c69-2434d299d77d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] validate_networks() for [('da9749f8-c5ef-4789-90a3-1ad249823d2e', None, None, None, None, None)] {{(pid=117847) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 10:05:15.883361 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f4b916fe-291c-4450-b5e8-f0a03ae9f5c3 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:15.892113 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f4b916fe-291c-4450-b5e8-f0a03ae9f5c3 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1736 microversion: 2.1 time: 0.237742 Jun 30 10:05:15.892793 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 320/620] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:15 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1736 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:05:15.897315 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ac6111a6-e290-42d1-b364-15deccaf7006 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:15.897844 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-ac6111a6-e290-42d1-b364-15deccaf7006 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 2270d4c1-54d0-468c-acc2-cc2dbc933058] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:15.903983 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ac6111a6-e290-42d1-b364-15deccaf7006 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:15.904449 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ac6111a6-e290-42d1-b364-15deccaf7006 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:15.905226 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ac6111a6-e290-42d1-b364-15deccaf7006 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:15.905647 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ac6111a6-e290-42d1-b364-15deccaf7006 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:15.936617 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ac6111a6-e290-42d1-b364-15deccaf7006 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:15.937051 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ac6111a6-e290-42d1-b364-15deccaf7006 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:15.937489 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.objects.instance [None req-ac6111a6-e290-42d1-b364-15deccaf7006 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lazy-loading 'fault' on Instance uuid 2270d4c1-54d0-468c-acc2-cc2dbc933058 {{(pid=117846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:05:15.997851 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ac6111a6-e290-42d1-b364-15deccaf7006 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f396e32bc48c0866a53122122bc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de5ed099cad4e6aa38f12d16cfb9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:16.012394 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ac6111a6-e290-42d1-b364-15deccaf7006 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/2270d4c1-54d0-468c-acc2-cc2dbc933058" status: 200 len: 1309 microversion: 2.1 time: 0.118439 Jun 30 10:05:16.012981 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 321/621] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:15 2022] GET /compute/v2.1/servers/2270d4c1-54d0-468c-acc2-cc2dbc933058 => generated 1309 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:05:16.271900 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-c94bdbce-71f2-482f-8c69-2434d299d77d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Flavor limits 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 10:05:16.272349 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-c94bdbce-71f2-482f-8c69-2434d299d77d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Image limits 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 10:05:16.272803 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-c94bdbce-71f2-482f-8c69-2434d299d77d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Flavor pref 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 10:05:16.273592 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-c94bdbce-71f2-482f-8c69-2434d299d77d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Image pref 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 10:05:16.274001 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-c94bdbce-71f2-482f-8c69-2434d299d77d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 10:05:16.284252 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c94bdbce-71f2-482f-8c69-2434d299d77d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:16.284739 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c94bdbce-71f2-482f-8c69-2434d299d77d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:16.285532 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c94bdbce-71f2-482f-8c69-2434d299d77d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:16.285968 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c94bdbce-71f2-482f-8c69-2434d299d77d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:16.304115 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.quota [None req-c94bdbce-71f2-482f-8c69-2434d299d77d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Getting quotas for project f43a6e910b6b47c09a859ac798bff5cd. Resources: {'ram', 'instances', 'cores'} {{(pid=117847) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:05:16.308592 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.quota [None req-c94bdbce-71f2-482f-8c69-2434d299d77d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Getting quotas for user 4b1614d524d24ce486741b599268995a and project f43a6e910b6b47c09a859ac798bff5cd. Resources: {'ram', 'instances', 'cores'} {{(pid=117847) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:05:16.320940 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-c94bdbce-71f2-482f-8c69-2434d299d77d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Going to run 1 instances... {{(pid=117847) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 10:05:16.323240 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-c94bdbce-71f2-482f-8c69-2434d299d77d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9dccba6-70d7-4aa8-9b8f-9c88ef1af443',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117847) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 10:05:16.370901 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-c94bdbce-71f2-482f-8c69-2434d299d77d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.688933 Jun 30 10:05:16.371544 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 301/622] 10.222.0.16 () {62 vars in 1187 bytes} [Thu Jun 30 10:05:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 30 10:05:16.383183 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-bd897cc9-c2ad-4430-973f-14628f23d6ec tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:16.383811 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-bd897cc9-c2ad-4430-973f-14628f23d6ec tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:16.440897 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-bd897cc9-c2ad-4430-973f-14628f23d6ec tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:16.450099 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-bd897cc9-c2ad-4430-973f-14628f23d6ec tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:16.452036 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-bd897cc9-c2ad-4430-973f-14628f23d6ec tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:16.453141 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-bd897cc9-c2ad-4430-973f-14628f23d6ec tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1282 microversion: 2.20 time: 0.074327 Jun 30 10:05:16.453838 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 322/623] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:05:16 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1282 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:05:16.909514 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-7e651b24-2d07-4e88-93dd-8a0e87434aa1 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:16.910111 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-7e651b24-2d07-4e88-93dd-8a0e87434aa1 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:16.917223 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7e651b24-2d07-4e88-93dd-8a0e87434aa1 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:16.917670 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7e651b24-2d07-4e88-93dd-8a0e87434aa1 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:16.918426 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7e651b24-2d07-4e88-93dd-8a0e87434aa1 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:16.918859 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7e651b24-2d07-4e88-93dd-8a0e87434aa1 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:17.030553 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-4e8c2570-1214-4206-aba2-807dd35be936 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:17.031250 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-4e8c2570-1214-4206-aba2-807dd35be936 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] [instance: 2270d4c1-54d0-468c-acc2-cc2dbc933058] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:17.038175 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4e8c2570-1214-4206-aba2-807dd35be936 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:17.038694 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4e8c2570-1214-4206-aba2-807dd35be936 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:17.039463 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4e8c2570-1214-4206-aba2-807dd35be936 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:17.039905 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4e8c2570-1214-4206-aba2-807dd35be936 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:17.052814 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-7e651b24-2d07-4e88-93dd-8a0e87434aa1 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:17.054899 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-4e8c2570-1214-4206-aba2-807dd35be936 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] HTTP exception thrown: Instance 2270d4c1-54d0-468c-acc2-cc2dbc933058 could not be found. Jun 30 10:05:17.056474 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-4e8c2570-1214-4206-aba2-807dd35be936 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Request method failure captured: Jun 30 10:05:17.056474 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: request: GET /compute/v2.1/servers/2270d4c1-54d0-468c-acc2-cc2dbc933058 HTTP/1.1 Jun 30 10:05:17.056474 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept: application/json Jun 30 10:05:17.056474 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jun 30 10:05:17.056474 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Connection: close Jun 30 10:05:17.056474 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jun 30 10:05:17.056474 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jun 30 10:05:17.056474 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Host: 10.222.0.16 Jun 30 10:05:17.056474 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jun 30 10:05:17.056474 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jun 30 10:05:17.056474 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABivXS8dMpigLjmiZFhfRUMARC0-yNbGzXMq6HrmIfPWBekeX6oWWuOlYPLigV9Ygv9SzgEo1GO8g-eCT4QjYtuOH7uYjt0JIVG8on9AxS9FeZYJCdQd2f53RWvmXWpTcLy64J4CIRl2ZP8qJDQFSo9r0zMgM85Zd6aAlB97cZWEKRGEmw Jun 30 10:05:17.056474 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jun 30 10:05:17.056474 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jun 30 10:05:17.056474 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jun 30 10:05:17.056474 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jun 30 10:05:17.056474 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jun 30 10:05:17.056474 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jun 30 10:05:17.056474 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Id: 8de5ed099cad4e6aa38f12d16cfb9615 Jun 30 10:05:17.056474 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1527204311 Jun 30 10:05:17.056474 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Role: reader,member Jun 30 10:05:17.056474 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Roles: reader,member Jun 30 10:05:17.057902 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8de5ed099cad4e6aa38f12d16cfb9615"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8de5ed099cad4e6aa38f12d16cfb9615"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8de5ed099cad4e6aa38f12d16cfb9615"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8de5ed099cad4e6aa38f12d16cfb9615"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:05:17.057902 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-VolumesSnapshotTestJSON-1527204311 Jun 30 10:05:17.057902 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 8de5ed099cad4e6aa38f12d16cfb9615 Jun 30 10:05:17.057902 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1527204311 Jun 30 10:05:17.057902 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User: tempest-VolumesSnapshotTestJSON-1527204311-project Jun 30 10:05:17.057902 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jun 30 10:05:17.057902 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jun 30 10:05:17.057902 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Id: 957f396e32bc48c0866a53122122bc7a Jun 30 10:05:17.057902 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-VolumesSnapshotTestJSON-1527204311-project Jun 30 10:05:17.057902 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: method: > Jun 30 10:05:17.057902 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: exception: Instance 2270d4c1-54d0-468c-acc2-cc2dbc933058 could not be found. Jun 30 10:05:17.057902 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: action_args: {'id': '2270d4c1-54d0-468c-acc2-cc2dbc933058'} Jun 30 10:05:17.058633 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:05:17.058633 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:05:17.058633 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:05:17.058633 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:05:17.058633 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:05:17.058633 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:05:17.058633 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:05:17.058633 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:05:17.058633 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:05:17.058633 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:05:17.058633 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2270d4c1-54d0-468c-acc2-cc2dbc933058 could not be found. Jun 30 10:05:17.058633 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:05:17.058633 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:05:17.058633 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:05:17.058633 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:05:17.058633 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:05:17.058633 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:05:17.058633 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:05:17.058633 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:05:17.058633 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:05:17.059774 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:05:17.059774 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:05:17.059774 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:05:17.059774 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:05:17.059774 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:05:17.059774 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:05:17.059774 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:05:17.059774 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2270d4c1-54d0-468c-acc2-cc2dbc933058 could not be found. Jun 30 10:05:17.059774 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:05:17.059774 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:05:17.059774 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:05:17.059774 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:05:17.059774 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:05:17.059774 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:05:17.059774 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:05:17.059774 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:05:17.059774 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2270d4c1-54d0-468c-acc2-cc2dbc933058 could not be found. Jun 30 10:05:17.059774 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:05:17.061061 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-4e8c2570-1214-4206-aba2-807dd35be936 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] Returning 404 to user: Instance 2270d4c1-54d0-468c-acc2-cc2dbc933058 could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:05:17.061061 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-4e8c2570-1214-4206-aba2-807dd35be936 tempest-VolumesSnapshotTestJSON-1527204311 tempest-VolumesSnapshotTestJSON-1527204311-project] 10.222.0.16 "GET /compute/v2.1/servers/2270d4c1-54d0-468c-acc2-cc2dbc933058" status: 404 len: 111 microversion: 2.1 time: 0.031402 Jun 30 10:05:17.061061 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 323/624] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:17 2022] GET /compute/v2.1/servers/2270d4c1-54d0-468c-acc2-cc2dbc933058 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 30 10:05:17.062920 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-7e651b24-2d07-4e88-93dd-8a0e87434aa1 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1736 microversion: 2.1 time: 0.157707 Jun 30 10:05:17.063590 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 302/625] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:16 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:05:17.471750 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-50a0bbc8-545e-4783-a1f5-fd3845765144 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:17.473019 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-50a0bbc8-545e-4783-a1f5-fd3845765144 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:17.480143 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-50a0bbc8-545e-4783-a1f5-fd3845765144 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:17.480588 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-50a0bbc8-545e-4783-a1f5-fd3845765144 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:17.482211 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-50a0bbc8-545e-4783-a1f5-fd3845765144 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:17.482762 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-50a0bbc8-545e-4783-a1f5-fd3845765144 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:17.554891 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-50a0bbc8-545e-4783-a1f5-fd3845765144 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:17.568976 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-50a0bbc8-545e-4783-a1f5-fd3845765144 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:17.571615 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-50a0bbc8-545e-4783-a1f5-fd3845765144 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:17.573073 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-50a0bbc8-545e-4783-a1f5-fd3845765144 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1352 microversion: 2.20 time: 0.106207 Jun 30 10:05:17.573919 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 324/626] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:05:17 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1352 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:05:18.081487 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-b5a189cc-1988-467e-babd-df6c518b6f9f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:18.082082 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-b5a189cc-1988-467e-babd-df6c518b6f9f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:18.084601 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:05:18.090099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b5a189cc-1988-467e-babd-df6c518b6f9f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:18.090583 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b5a189cc-1988-467e-babd-df6c518b6f9f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:18.091335 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b5a189cc-1988-467e-babd-df6c518b6f9f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:18.091782 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b5a189cc-1988-467e-babd-df6c518b6f9f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:18.096437 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:05:18.242704 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-b5a189cc-1988-467e-babd-df6c518b6f9f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:18.255511 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-b5a189cc-1988-467e-babd-df6c518b6f9f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1736 microversion: 2.1 time: 0.177717 Jun 30 10:05:18.256401 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 303/627] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:18 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:05:18.601744 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-5dd3fd59-ad56-4f4b-bd39-2c438709ddeb tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:18.602639 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-5dd3fd59-ad56-4f4b-bd39-2c438709ddeb tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:18.610044 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5dd3fd59-ad56-4f4b-bd39-2c438709ddeb tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:18.610495 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5dd3fd59-ad56-4f4b-bd39-2c438709ddeb tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:18.611275 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5dd3fd59-ad56-4f4b-bd39-2c438709ddeb tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:18.611741 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5dd3fd59-ad56-4f4b-bd39-2c438709ddeb tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:18.849286 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-5dd3fd59-ad56-4f4b-bd39-2c438709ddeb tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:18.857885 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-5dd3fd59-ad56-4f4b-bd39-2c438709ddeb tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:18.859391 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-5dd3fd59-ad56-4f4b-bd39-2c438709ddeb tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:18.860478 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-5dd3fd59-ad56-4f4b-bd39-2c438709ddeb tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1340 microversion: 2.20 time: 0.271299 Jun 30 10:05:18.861088 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 325/628] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:05:18 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1340 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:05:19.273912 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-463b325a-4955-4b0c-a3ae-680a52904a57 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:19.274546 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-463b325a-4955-4b0c-a3ae-680a52904a57 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:19.286506 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-463b325a-4955-4b0c-a3ae-680a52904a57 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:19.287402 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-463b325a-4955-4b0c-a3ae-680a52904a57 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:19.288427 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-463b325a-4955-4b0c-a3ae-680a52904a57 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:19.289012 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-463b325a-4955-4b0c-a3ae-680a52904a57 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:19.428236 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-463b325a-4955-4b0c-a3ae-680a52904a57 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:19.436291 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-463b325a-4955-4b0c-a3ae-680a52904a57 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1736 microversion: 2.1 time: 0.167219 Jun 30 10:05:19.436824 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 304/629] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:19 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:05:19.882632 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-fee4303a-988a-42da-b14c-144b85204961 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:19.883613 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-fee4303a-988a-42da-b14c-144b85204961 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:19.892858 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fee4303a-988a-42da-b14c-144b85204961 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:19.893300 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fee4303a-988a-42da-b14c-144b85204961 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:19.894053 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fee4303a-988a-42da-b14c-144b85204961 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:19.894481 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fee4303a-988a-42da-b14c-144b85204961 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:20.029585 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-fee4303a-988a-42da-b14c-144b85204961 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:20.037649 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-fee4303a-988a-42da-b14c-144b85204961 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:20.039151 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-fee4303a-988a-42da-b14c-144b85204961 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:20.040286 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-fee4303a-988a-42da-b14c-144b85204961 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1407 microversion: 2.20 time: 0.164193 Jun 30 10:05:20.040847 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 326/630] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:05:19 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:05:20.456520 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-8206229b-e317-465f-bb61-b4ccaa38b052 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:20.457123 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-8206229b-e317-465f-bb61-b4ccaa38b052 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:20.466109 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8206229b-e317-465f-bb61-b4ccaa38b052 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:20.466690 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8206229b-e317-465f-bb61-b4ccaa38b052 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:20.467697 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8206229b-e317-465f-bb61-b4ccaa38b052 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:20.468360 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8206229b-e317-465f-bb61-b4ccaa38b052 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:20.607145 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-8206229b-e317-465f-bb61-b4ccaa38b052 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:20.615642 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-8206229b-e317-465f-bb61-b4ccaa38b052 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1736 microversion: 2.1 time: 0.165125 Jun 30 10:05:20.616307 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 305/631] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:20 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:05:21.059897 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ce0704c3-aa13-42b8-86f9-fce0fc79efd2 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:21.060650 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-ce0704c3-aa13-42b8-86f9-fce0fc79efd2 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:21.069828 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ce0704c3-aa13-42b8-86f9-fce0fc79efd2 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:21.070387 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ce0704c3-aa13-42b8-86f9-fce0fc79efd2 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:21.071336 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ce0704c3-aa13-42b8-86f9-fce0fc79efd2 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:21.071896 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ce0704c3-aa13-42b8-86f9-fce0fc79efd2 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:21.211526 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ce0704c3-aa13-42b8-86f9-fce0fc79efd2 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:21.220472 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ce0704c3-aa13-42b8-86f9-fce0fc79efd2 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:21.221983 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ce0704c3-aa13-42b8-86f9-fce0fc79efd2 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:21.223099 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ce0704c3-aa13-42b8-86f9-fce0fc79efd2 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1407 microversion: 2.20 time: 0.168133 Jun 30 10:05:21.223711 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 327/632] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:05:21 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:05:21.633515 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-b0c9900c-2634-4689-81bc-f43a473b089b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:21.634868 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-b0c9900c-2634-4689-81bc-f43a473b089b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:21.642082 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b0c9900c-2634-4689-81bc-f43a473b089b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:21.642530 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b0c9900c-2634-4689-81bc-f43a473b089b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:21.643288 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b0c9900c-2634-4689-81bc-f43a473b089b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:21.643755 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b0c9900c-2634-4689-81bc-f43a473b089b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:21.852495 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-b0c9900c-2634-4689-81bc-f43a473b089b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:21.862398 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-b0c9900c-2634-4689-81bc-f43a473b089b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1736 microversion: 2.1 time: 0.232621 Jun 30 10:05:21.862952 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 306/633] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:21 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1736 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:05:22.159198 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-884d96b4-462e-49de-94bc-747555123d13 req-87c0fa2d-803e-4fa6-b5a1-77bf577f22b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ac05989-c74b-4ae8-90c2-b1c16bd45f87", "tag": "b21d9a4d-e7dc-4e74-9943-8abf6db35a29"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:05:22.169606 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-884d96b4-462e-49de-94bc-747555123d13 req-87c0fa2d-803e-4fa6-b5a1-77bf577f22b9 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:22.170283 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-884d96b4-462e-49de-94bc-747555123d13 req-87c0fa2d-803e-4fa6-b5a1-77bf577f22b9 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:22.182683 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-884d96b4-462e-49de-94bc-747555123d13 req-87c0fa2d-803e-4fa6-b5a1-77bf577f22b9 service nova] Creating event network-changed:b21d9a4d-e7dc-4e74-9943-8abf6db35a29 for instance 4ac05989-c74b-4ae8-90c2-b1c16bd45f87 on hv-cinder-84330 Jun 30 10:05:22.187601 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-884d96b4-462e-49de-94bc-747555123d13 req-87c0fa2d-803e-4fa6-b5a1-77bf577f22b9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032400 Jun 30 10:05:22.188282 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 328/634] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:05:22.245250 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-0eb10a77-332f-434d-a46a-f0af5ad775e5 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:22.245815 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-0eb10a77-332f-434d-a46a-f0af5ad775e5 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:22.252490 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-0eb10a77-332f-434d-a46a-f0af5ad775e5 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:22.253362 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-0eb10a77-332f-434d-a46a-f0af5ad775e5 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:22.254371 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-0eb10a77-332f-434d-a46a-f0af5ad775e5 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:22.254768 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-0eb10a77-332f-434d-a46a-f0af5ad775e5 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:22.474278 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-0eb10a77-332f-434d-a46a-f0af5ad775e5 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:22.484622 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-0eb10a77-332f-434d-a46a-f0af5ad775e5 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:22.486438 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-0eb10a77-332f-434d-a46a-f0af5ad775e5 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:22.487575 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-0eb10a77-332f-434d-a46a-f0af5ad775e5 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1407 microversion: 2.20 time: 0.246481 Jun 30 10:05:22.488460 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 307/635] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:05:22 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:05:22.881400 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-5014481f-a476-41f0-b647-5beedff2e52a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:22.882117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-5014481f-a476-41f0-b647-5beedff2e52a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:22.889419 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5014481f-a476-41f0-b647-5beedff2e52a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:22.889907 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5014481f-a476-41f0-b647-5beedff2e52a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:22.890910 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5014481f-a476-41f0-b647-5beedff2e52a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:22.891394 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5014481f-a476-41f0-b647-5beedff2e52a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:23.028103 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-5014481f-a476-41f0-b647-5beedff2e52a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:23.037748 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-5014481f-a476-41f0-b647-5beedff2e52a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1736 microversion: 2.1 time: 0.160922 Jun 30 10:05:23.038673 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 329/636] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:22 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:05:23.506428 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-c943eb19-d18e-4d41-9bf8-07954f00992d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:23.507033 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-c943eb19-d18e-4d41-9bf8-07954f00992d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:23.515775 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c943eb19-d18e-4d41-9bf8-07954f00992d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:23.516460 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c943eb19-d18e-4d41-9bf8-07954f00992d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:23.517337 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c943eb19-d18e-4d41-9bf8-07954f00992d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:23.518008 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c943eb19-d18e-4d41-9bf8-07954f00992d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:23.657026 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-c943eb19-d18e-4d41-9bf8-07954f00992d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:23.665507 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-c943eb19-d18e-4d41-9bf8-07954f00992d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:23.667046 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-c943eb19-d18e-4d41-9bf8-07954f00992d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:23.668114 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-c943eb19-d18e-4d41-9bf8-07954f00992d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1407 microversion: 2.20 time: 0.165748 Jun 30 10:05:23.668667 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 308/637] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:05:23 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:05:24.059044 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-cca0da90-aa47-44fd-acd8-aa3bd0c8e368 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:24.059958 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-cca0da90-aa47-44fd-acd8-aa3bd0c8e368 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:24.071363 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cca0da90-aa47-44fd-acd8-aa3bd0c8e368 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:24.072164 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cca0da90-aa47-44fd-acd8-aa3bd0c8e368 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:24.073414 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cca0da90-aa47-44fd-acd8-aa3bd0c8e368 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:24.074130 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cca0da90-aa47-44fd-acd8-aa3bd0c8e368 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:24.217925 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-cca0da90-aa47-44fd-acd8-aa3bd0c8e368 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:24.226065 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-cca0da90-aa47-44fd-acd8-aa3bd0c8e368 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1716 microversion: 2.1 time: 0.173561 Jun 30 10:05:24.226621 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 330/638] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:24 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1716 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:05:24.342061 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-f7ce9908-2979-49c1-af4d-e5f37d93d35d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:24.342553 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-f7ce9908-2979-49c1-af4d-e5f37d93d35d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:24.348851 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-f7ce9908-2979-49c1-af4d-e5f37d93d35d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:24.349312 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-f7ce9908-2979-49c1-af4d-e5f37d93d35d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:24.350070 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-f7ce9908-2979-49c1-af4d-e5f37d93d35d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:24.350503 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-f7ce9908-2979-49c1-af4d-e5f37d93d35d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:24.609001 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.wsgi [None req-f7ce9908-2979-49c1-af4d-e5f37d93d35d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] HTTP exception thrown: Cannot 'detach_volume' instance 114a9363-7f11-4906-959f-37a7d3275e52 while it is in vm_state rescued Jun 30 10:05:24.610656 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-f7ce9908-2979-49c1-af4d-e5f37d93d35d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Request method failure captured: Jun 30 10:05:24.610656 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: request: DELETE /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52/os-volume_attachments/4cdac408-153b-4727-b5e0-3308a5cbe964 HTTP/1.1 Jun 30 10:05:24.610656 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept: application/json Jun 30 10:05:24.610656 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept-Encoding: identity Jun 30 10:05:24.610656 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Connection: close Jun 30 10:05:24.610656 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Length: 0 Jun 30 10:05:24.610656 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Type: application/json Jun 30 10:05:24.610656 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Host: 10.222.0.16 Jun 30 10:05:24.610656 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Openstack-System-Scope: None Jun 30 10:05:24.610656 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: User-Agent: python-urllib3/1.26.9 Jun 30 10:05:24.610656 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Auth-Token: gAAAAABivXQ_-92o37DZs6KJkFkKOmwxkiwRqM5n-bwQzekE2akVqDN2T3UK3mXb5Q8vEgciD0-EZqDYHyMkNaHedrwR7kZ3VKOpjwe1q5N7_yLnQiQ9zWLbjXnQrmxPyI_YaSVtdEv4Ga6FaF9gEp45Vke44RdWPpPt0d1FP07cbOTc_eXjbzk Jun 30 10:05:24.610656 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Id: None Jun 30 10:05:24.610656 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Name: None Jun 30 10:05:24.610656 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Identity-Status: Confirmed Jun 30 10:05:24.610656 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Is-Admin-Project: True Jun 30 10:05:24.610656 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Id: default Jun 30 10:05:24.610656 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Name: Default Jun 30 10:05:24.610656 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Id: 0e8bc4e999ce4f1e9f52b456bcdd88d3 Jun 30 10:05:24.610656 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1274875426 Jun 30 10:05:24.610656 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Role: reader,member Jun 30 10:05:24.610656 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Roles: reader,member Jun 30 10:05:24.612257 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e8bc4e999ce4f1e9f52b456bcdd88d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0e8bc4e999ce4f1e9f52b456bcdd88d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e8bc4e999ce4f1e9f52b456bcdd88d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0e8bc4e999ce4f1e9f52b456bcdd88d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:05:24.612257 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1274875426 Jun 30 10:05:24.612257 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Id: 0e8bc4e999ce4f1e9f52b456bcdd88d3 Jun 30 10:05:24.612257 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1274875426 Jun 30 10:05:24.612257 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User: tempest-ServerRescueNegativeTestJSON-1274875426-project Jun 30 10:05:24.612257 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Id: default Jun 30 10:05:24.612257 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Name: Default Jun 30 10:05:24.612257 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Id: a179e34636ed4970be4f0790115f9d8f Jun 30 10:05:24.612257 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1274875426-project Jun 30 10:05:24.612257 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: method: > Jun 30 10:05:24.612257 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: exception: Cannot 'detach_volume' instance 114a9363-7f11-4906-959f-37a7d3275e52 while it is in vm_state rescued Jun 30 10:05:24.613065 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: action_args: {'server_id': '114a9363-7f11-4906-959f-37a7d3275e52', 'id': '4cdac408-153b-4727-b5e0-3308a5cbe964'} Jun 30 10:05:24.613065 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:05:24.613065 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:05:24.613065 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 30 10:05:24.613065 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 30 10:05:24.613065 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 30 10:05:24.613065 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 30 10:05:24.613065 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 30 10:05:24.613065 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 30 10:05:24.613065 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 114a9363-7f11-4906-959f-37a7d3275e52 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 30 10:05:24.613065 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:05:24.613065 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:05:24.613065 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:05:24.613065 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:05:24.613065 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:05:24.613065 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:05:24.613065 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:05:24.613065 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:05:24.613065 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:05:24.613065 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:05:24.614566 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 30 10:05:24.614566 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 30 10:05:24.614566 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 30 10:05:24.614566 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 30 10:05:24.614566 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 114a9363-7f11-4906-959f-37a7d3275e52 while it is in vm_state rescued Jun 30 10:05:24.614566 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:05:24.614566 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:05:24.614566 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:05:24.614566 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:05:24.614566 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:05:24.614566 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:05:24.614566 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:05:24.614566 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:05:24.614566 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 114a9363-7f11-4906-959f-37a7d3275e52 while it is in vm_state rescued Jun 30 10:05:24.614566 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:05:24.614566 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-f7ce9908-2979-49c1-af4d-e5f37d93d35d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Returning 409 to user: Cannot 'detach_volume' instance 114a9363-7f11-4906-959f-37a7d3275e52 while it is in vm_state rescued {{(pid=117847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:05:24.615734 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-f7ce9908-2979-49c1-af4d-e5f37d93d35d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "DELETE /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52/os-volume_attachments/4cdac408-153b-4727-b5e0-3308a5cbe964" status: 409 len: 152 microversion: 2.1 time: 0.274508 Jun 30 10:05:24.615734 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 309/639] 10.222.0.16 () {58 vars in 1415 bytes} [Thu Jun 30 10:05:24 2022] DELETE /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52/os-volume_attachments/4cdac408-153b-4727-b5e0-3308a5cbe964 => generated 152 bytes in 276 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 30 10:05:24.621255 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e38c9597-189f-4786-80fb-cc8109fee835 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:05:24.621849 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-e38c9597-189f-4786-80fb-cc8109fee835 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:24.628333 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e38c9597-189f-4786-80fb-cc8109fee835 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:24.628768 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e38c9597-189f-4786-80fb-cc8109fee835 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:24.629546 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e38c9597-189f-4786-80fb-cc8109fee835 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:24.629968 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e38c9597-189f-4786-80fb-cc8109fee835 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:24.686986 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-368ebf09-8d56-4ad2-aaa7-42ce2c0822e9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:24.687714 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-368ebf09-8d56-4ad2-aaa7-42ce2c0822e9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:24.694249 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-368ebf09-8d56-4ad2-aaa7-42ce2c0822e9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:24.694686 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-368ebf09-8d56-4ad2-aaa7-42ce2c0822e9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:24.695453 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-368ebf09-8d56-4ad2-aaa7-42ce2c0822e9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:24.695897 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-368ebf09-8d56-4ad2-aaa7-42ce2c0822e9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:24.700817 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-e38c9597-189f-4786-80fb-cc8109fee835 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "POST /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52/action" status: 202 len: 0 microversion: 2.1 time: 0.083533 Jun 30 10:05:24.701694 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 331/640] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Jun 30 10:05:24 2022] POST /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:05:24.710861 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-85e8d6ad-80c5-447d-919f-441893245233 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:24.711546 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-85e8d6ad-80c5-447d-919f-441893245233 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:24.717841 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-85e8d6ad-80c5-447d-919f-441893245233 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:24.718292 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-85e8d6ad-80c5-447d-919f-441893245233 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:24.719178 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-85e8d6ad-80c5-447d-919f-441893245233 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:24.719668 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-85e8d6ad-80c5-447d-919f-441893245233 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:24.847732 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-368ebf09-8d56-4ad2-aaa7-42ce2c0822e9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:24.856011 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-368ebf09-8d56-4ad2-aaa7-42ce2c0822e9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:24.857568 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-368ebf09-8d56-4ad2-aaa7-42ce2c0822e9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:24.858612 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-368ebf09-8d56-4ad2-aaa7-42ce2c0822e9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1407 microversion: 2.20 time: 0.175946 Jun 30 10:05:24.859230 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 310/641] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:05:24 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:05:25.068248 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-85e8d6ad-80c5-447d-919f-441893245233 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:25.076339 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-85e8d6ad-80c5-447d-919f-441893245233 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1724 microversion: 2.1 time: 0.369967 Jun 30 10:05:25.076897 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 332/642] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:24 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1724 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:05:25.879163 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-01555edd-f843-4279-9af4-83a07cfc4ab7 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:25.879815 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-01555edd-f843-4279-9af4-83a07cfc4ab7 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:25.886492 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-01555edd-f843-4279-9af4-83a07cfc4ab7 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:25.886955 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-01555edd-f843-4279-9af4-83a07cfc4ab7 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:25.887738 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-01555edd-f843-4279-9af4-83a07cfc4ab7 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:25.888215 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-01555edd-f843-4279-9af4-83a07cfc4ab7 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:26.032309 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-01555edd-f843-4279-9af4-83a07cfc4ab7 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:26.040566 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-01555edd-f843-4279-9af4-83a07cfc4ab7 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:26.042046 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-01555edd-f843-4279-9af4-83a07cfc4ab7 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:26.043128 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-01555edd-f843-4279-9af4-83a07cfc4ab7 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1407 microversion: 2.20 time: 0.168704 Jun 30 10:05:26.043717 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 311/643] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:05:25 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:05:26.093883 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ef3a5968-623a-43e1-87eb-f68161470488 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:26.094615 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-ef3a5968-623a-43e1-87eb-f68161470488 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:26.100848 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ef3a5968-623a-43e1-87eb-f68161470488 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:26.101287 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ef3a5968-623a-43e1-87eb-f68161470488 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:26.102027 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ef3a5968-623a-43e1-87eb-f68161470488 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:26.102454 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ef3a5968-623a-43e1-87eb-f68161470488 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:26.241879 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ef3a5968-623a-43e1-87eb-f68161470488 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:26.249933 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ef3a5968-623a-43e1-87eb-f68161470488 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1724 microversion: 2.1 time: 0.159918 Jun 30 10:05:26.250519 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 333/644] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:26 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:05:27.063375 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-c17f8a6b-229a-415e-85f8-cffc116a2201 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:27.064443 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-c17f8a6b-229a-415e-85f8-cffc116a2201 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:27.066865 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell0:SELECT=2 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:05:27.067708 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell0:SELECT=6 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:05:27.075328 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c17f8a6b-229a-415e-85f8-cffc116a2201 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:27.075847 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c17f8a6b-229a-415e-85f8-cffc116a2201 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:27.076789 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c17f8a6b-229a-415e-85f8-cffc116a2201 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:27.077345 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c17f8a6b-229a-415e-85f8-cffc116a2201 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:27.228852 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-c17f8a6b-229a-415e-85f8-cffc116a2201 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:27.237970 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-c17f8a6b-229a-415e-85f8-cffc116a2201 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:27.239471 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-c17f8a6b-229a-415e-85f8-cffc116a2201 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:27.240630 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-c17f8a6b-229a-415e-85f8-cffc116a2201 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1407 microversion: 2.20 time: 0.182352 Jun 30 10:05:27.241181 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 312/645] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:05:27 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:05:27.266759 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-1726aeac-be94-43d1-9d89-a0713ed7203b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:27.267503 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-1726aeac-be94-43d1-9d89-a0713ed7203b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:27.269495 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=6 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:05:27.275775 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1726aeac-be94-43d1-9d89-a0713ed7203b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:27.276248 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1726aeac-be94-43d1-9d89-a0713ed7203b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:27.277015 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1726aeac-be94-43d1-9d89-a0713ed7203b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:27.277452 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1726aeac-be94-43d1-9d89-a0713ed7203b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:27.424426 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-1726aeac-be94-43d1-9d89-a0713ed7203b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:27.436393 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-1726aeac-be94-43d1-9d89-a0713ed7203b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1724 microversion: 2.1 time: 0.173511 Jun 30 10:05:27.437144 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 334/646] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:27 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:05:28.262292 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-8a43e950-97f2-4025-8e7e-b4626ea4c1c1 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:28.263267 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-8a43e950-97f2-4025-8e7e-b4626ea4c1c1 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:28.274256 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8a43e950-97f2-4025-8e7e-b4626ea4c1c1 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:28.275017 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8a43e950-97f2-4025-8e7e-b4626ea4c1c1 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:28.276460 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8a43e950-97f2-4025-8e7e-b4626ea4c1c1 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:28.277170 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8a43e950-97f2-4025-8e7e-b4626ea4c1c1 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:28.412959 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-8a43e950-97f2-4025-8e7e-b4626ea4c1c1 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:28.426421 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-8a43e950-97f2-4025-8e7e-b4626ea4c1c1 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:28.428942 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-8a43e950-97f2-4025-8e7e-b4626ea4c1c1 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:28.430605 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-8a43e950-97f2-4025-8e7e-b4626ea4c1c1 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1407 microversion: 2.20 time: 0.174508 Jun 30 10:05:28.431446 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 313/647] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:05:28 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:05:28.455075 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-874979b7-7103-4d4f-90b5-883905979c6b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:28.455689 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-874979b7-7103-4d4f-90b5-883905979c6b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:28.462523 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-874979b7-7103-4d4f-90b5-883905979c6b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:28.462965 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-874979b7-7103-4d4f-90b5-883905979c6b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:28.463711 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-874979b7-7103-4d4f-90b5-883905979c6b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:28.464168 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-874979b7-7103-4d4f-90b5-883905979c6b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:28.601819 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-874979b7-7103-4d4f-90b5-883905979c6b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:28.610491 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-874979b7-7103-4d4f-90b5-883905979c6b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1724 microversion: 2.1 time: 0.159634 Jun 30 10:05:28.611055 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 335/648] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:28 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:05:29.455696 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-be848277-c7b4-43af-87eb-8b251c316daa tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:29.456300 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-be848277-c7b4-43af-87eb-8b251c316daa tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:29.463988 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-be848277-c7b4-43af-87eb-8b251c316daa tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:29.464477 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-be848277-c7b4-43af-87eb-8b251c316daa tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:29.465303 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-be848277-c7b4-43af-87eb-8b251c316daa tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:29.465770 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-be848277-c7b4-43af-87eb-8b251c316daa tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:29.614072 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-be848277-c7b4-43af-87eb-8b251c316daa tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:29.625950 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-be848277-c7b4-43af-87eb-8b251c316daa tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:29.627843 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-be848277-c7b4-43af-87eb-8b251c316daa tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:29.629007 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-be848277-c7b4-43af-87eb-8b251c316daa tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1407 microversion: 2.20 time: 0.179370 Jun 30 10:05:29.629526 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 314/649] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:05:29 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:05:29.632203 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-6c10a8ba-09a1-4ede-82ed-9daac26b6446 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:29.632796 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-6c10a8ba-09a1-4ede-82ed-9daac26b6446 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:29.639504 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6c10a8ba-09a1-4ede-82ed-9daac26b6446 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:29.639972 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6c10a8ba-09a1-4ede-82ed-9daac26b6446 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:29.640722 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6c10a8ba-09a1-4ede-82ed-9daac26b6446 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:29.641151 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6c10a8ba-09a1-4ede-82ed-9daac26b6446 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:29.773710 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-6c10a8ba-09a1-4ede-82ed-9daac26b6446 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:29.782129 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-6c10a8ba-09a1-4ede-82ed-9daac26b6446 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1724 microversion: 2.1 time: 0.153400 Jun 30 10:05:29.782514 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 336/650] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:29 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:05:30.647365 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-f3c63a6c-61bc-4936-a35e-0b999dab5afa tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:30.647995 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-f3c63a6c-61bc-4936-a35e-0b999dab5afa tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:30.657735 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-f3c63a6c-61bc-4936-a35e-0b999dab5afa tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:30.658244 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-f3c63a6c-61bc-4936-a35e-0b999dab5afa tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:30.659159 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-f3c63a6c-61bc-4936-a35e-0b999dab5afa tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:30.660449 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-f3c63a6c-61bc-4936-a35e-0b999dab5afa tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:30.799297 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-05542e1b-cada-4aa9-9325-8f27a1fccb77 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:30.799970 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-05542e1b-cada-4aa9-9325-8f27a1fccb77 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:30.801089 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-f3c63a6c-61bc-4936-a35e-0b999dab5afa tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:30.806748 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-05542e1b-cada-4aa9-9325-8f27a1fccb77 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:30.807217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-05542e1b-cada-4aa9-9325-8f27a1fccb77 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:30.808018 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-05542e1b-cada-4aa9-9325-8f27a1fccb77 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:30.808451 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-05542e1b-cada-4aa9-9325-8f27a1fccb77 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:30.809269 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-f3c63a6c-61bc-4936-a35e-0b999dab5afa tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:30.810798 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-f3c63a6c-61bc-4936-a35e-0b999dab5afa tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:30.811906 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-f3c63a6c-61bc-4936-a35e-0b999dab5afa tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1407 microversion: 2.20 time: 0.168682 Jun 30 10:05:30.812447 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 315/651] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:05:30 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:05:30.943603 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-05542e1b-cada-4aa9-9325-8f27a1fccb77 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:30.951910 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-05542e1b-cada-4aa9-9325-8f27a1fccb77 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1730 microversion: 2.1 time: 0.156967 Jun 30 10:05:30.952479 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 337/652] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:30 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:05:30.973980 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-fe9de890-afb5-4e9a-a963-1b85b501cb44 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:30.974743 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-fe9de890-afb5-4e9a-a963-1b85b501cb44 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:30.980908 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-fe9de890-afb5-4e9a-a963-1b85b501cb44 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:30.981347 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-fe9de890-afb5-4e9a-a963-1b85b501cb44 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:30.982093 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-fe9de890-afb5-4e9a-a963-1b85b501cb44 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:30.982514 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-fe9de890-afb5-4e9a-a963-1b85b501cb44 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:31.089338 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-fe9de890-afb5-4e9a-a963-1b85b501cb44 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.119546 Jun 30 10:05:31.090557 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 316/653] 10.222.0.16 () {58 vars in 1274 bytes} [Thu Jun 30 10:05:30 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52/os-interface => generated 284 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:05:31.831471 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-d68251fb-4050-4c6b-abc5-9d1c6c92f6ef tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:31.832069 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-d68251fb-4050-4c6b-abc5-9d1c6c92f6ef tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:31.839010 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d68251fb-4050-4c6b-abc5-9d1c6c92f6ef tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:31.839459 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d68251fb-4050-4c6b-abc5-9d1c6c92f6ef tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:31.840253 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d68251fb-4050-4c6b-abc5-9d1c6c92f6ef tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:31.840695 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d68251fb-4050-4c6b-abc5-9d1c6c92f6ef tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:31.843238 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:05:32.141635 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-d68251fb-4050-4c6b-abc5-9d1c6c92f6ef tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:32.150341 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-d68251fb-4050-4c6b-abc5-9d1c6c92f6ef tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:32.152393 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-d68251fb-4050-4c6b-abc5-9d1c6c92f6ef tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:32.153660 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-d68251fb-4050-4c6b-abc5-9d1c6c92f6ef tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1407 microversion: 2.20 time: 0.327045 Jun 30 10:05:32.154532 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 338/654] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:05:31 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1407 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:05:32.618326 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [req-c7f9a622-4770-4652-9dbb-37fd985d06ef req-6bbfb350-a30d-4d06-8b2f-6aad7ab7fd27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "114a9363-7f11-4906-959f-37a7d3275e52", "tag": "290c2729-5bcd-422d-afde-63f591011bcf"}]} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:05:32.626857 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-c7f9a622-4770-4652-9dbb-37fd985d06ef req-6bbfb350-a30d-4d06-8b2f-6aad7ab7fd27 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:32.627296 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-c7f9a622-4770-4652-9dbb-37fd985d06ef req-6bbfb350-a30d-4d06-8b2f-6aad7ab7fd27 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:32.638405 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.compute.server_external_events [req-c7f9a622-4770-4652-9dbb-37fd985d06ef req-6bbfb350-a30d-4d06-8b2f-6aad7ab7fd27 service nova] Creating event network-changed:290c2729-5bcd-422d-afde-63f591011bcf for instance 114a9363-7f11-4906-959f-37a7d3275e52 on hv-cinder-84330 Jun 30 10:05:32.643913 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [req-c7f9a622-4770-4652-9dbb-37fd985d06ef req-6bbfb350-a30d-4d06-8b2f-6aad7ab7fd27 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029776 Jun 30 10:05:32.645030 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 317/655] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:05:32.696816 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-7a0509e4-fbdc-49f8-85bd-d2d161a4aae9 req-446b7af2-b43b-4665-b221-e8137f40803f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ac05989-c74b-4ae8-90c2-b1c16bd45f87", "name": "network-vif-plugged", "status": "completed", "tag": "b21d9a4d-e7dc-4e74-9943-8abf6db35a29"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:05:32.707708 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-7a0509e4-fbdc-49f8-85bd-d2d161a4aae9 req-446b7af2-b43b-4665-b221-e8137f40803f service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:32.708583 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-7a0509e4-fbdc-49f8-85bd-d2d161a4aae9 req-446b7af2-b43b-4665-b221-e8137f40803f service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:32.723026 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-7a0509e4-fbdc-49f8-85bd-d2d161a4aae9 req-446b7af2-b43b-4665-b221-e8137f40803f service nova] Creating event network-vif-plugged:b21d9a4d-e7dc-4e74-9943-8abf6db35a29 for instance 4ac05989-c74b-4ae8-90c2-b1c16bd45f87 on hv-cinder-84330 Jun 30 10:05:32.729048 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-7a0509e4-fbdc-49f8-85bd-d2d161a4aae9 req-446b7af2-b43b-4665-b221-e8137f40803f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035963 Jun 30 10:05:32.730253 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 339/656] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:05:33.173724 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-c3ee3d39-1626-4ffe-9316-af3b42af4ab3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:33.174403 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-c3ee3d39-1626-4ffe-9316-af3b42af4ab3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:33.181042 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c3ee3d39-1626-4ffe-9316-af3b42af4ab3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:33.181482 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c3ee3d39-1626-4ffe-9316-af3b42af4ab3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:33.182255 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c3ee3d39-1626-4ffe-9316-af3b42af4ab3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:33.182940 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c3ee3d39-1626-4ffe-9316-af3b42af4ab3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:33.377040 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-c3ee3d39-1626-4ffe-9316-af3b42af4ab3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:33.385648 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-c3ee3d39-1626-4ffe-9316-af3b42af4ab3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:33.387173 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-c3ee3d39-1626-4ffe-9316-af3b42af4ab3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:33.388322 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-c3ee3d39-1626-4ffe-9316-af3b42af4ab3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1407 microversion: 2.20 time: 0.219248 Jun 30 10:05:33.388887 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 318/657] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:05:33 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:05:34.410562 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-7d1def3e-23e8-4735-8576-d7d0f2d86577 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:34.411382 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-7d1def3e-23e8-4735-8576-d7d0f2d86577 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:34.420207 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7d1def3e-23e8-4735-8576-d7d0f2d86577 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:34.420777 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7d1def3e-23e8-4735-8576-d7d0f2d86577 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:34.421732 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7d1def3e-23e8-4735-8576-d7d0f2d86577 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:34.422230 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7d1def3e-23e8-4735-8576-d7d0f2d86577 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:34.579396 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7d1def3e-23e8-4735-8576-d7d0f2d86577 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:34.588035 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7d1def3e-23e8-4735-8576-d7d0f2d86577 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:34.589528 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7d1def3e-23e8-4735-8576-d7d0f2d86577 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:34.590637 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-7d1def3e-23e8-4735-8576-d7d0f2d86577 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1407 microversion: 2.20 time: 0.186723 Jun 30 10:05:34.591199 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 340/658] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:05:34 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:05:34.659939 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [req-7fb3de8e-83db-488b-99a4-6d9e562dd029 req-7f49ac23-2a0b-426f-a31e-883a4d38ec06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "114a9363-7f11-4906-959f-37a7d3275e52", "tag": "290c2729-5bcd-422d-afde-63f591011bcf"}]} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:05:34.668732 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-7fb3de8e-83db-488b-99a4-6d9e562dd029 req-7f49ac23-2a0b-426f-a31e-883a4d38ec06 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:34.669159 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-7fb3de8e-83db-488b-99a4-6d9e562dd029 req-7f49ac23-2a0b-426f-a31e-883a4d38ec06 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:34.680371 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.compute.server_external_events [req-7fb3de8e-83db-488b-99a4-6d9e562dd029 req-7f49ac23-2a0b-426f-a31e-883a4d38ec06 service nova] Creating event network-changed:290c2729-5bcd-422d-afde-63f591011bcf for instance 114a9363-7f11-4906-959f-37a7d3275e52 on hv-cinder-84330 Jun 30 10:05:34.685328 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [req-7fb3de8e-83db-488b-99a4-6d9e562dd029 req-7f49ac23-2a0b-426f-a31e-883a4d38ec06 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029048 Jun 30 10:05:34.685896 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 319/659] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:05:35.618171 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-b00a5408-2882-423d-9697-cf957083b197 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:35.619253 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-b00a5408-2882-423d-9697-cf957083b197 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:35.628741 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b00a5408-2882-423d-9697-cf957083b197 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:35.629181 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b00a5408-2882-423d-9697-cf957083b197 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:35.629938 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b00a5408-2882-423d-9697-cf957083b197 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:35.630356 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b00a5408-2882-423d-9697-cf957083b197 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:35.773541 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-b00a5408-2882-423d-9697-cf957083b197 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:35.781607 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-b00a5408-2882-423d-9697-cf957083b197 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:35.783486 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-b00a5408-2882-423d-9697-cf957083b197 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:35.784657 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-b00a5408-2882-423d-9697-cf957083b197 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1600 microversion: 2.20 time: 0.173074 Jun 30 10:05:35.785209 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 341/660] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:05:35 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1600 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:05:35.803405 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-cf17df8d-f30e-454c-b702-eea407bdce4f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:35.803987 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-cf17df8d-f30e-454c-b702-eea407bdce4f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:35.810390 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-cf17df8d-f30e-454c-b702-eea407bdce4f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:35.810850 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-cf17df8d-f30e-454c-b702-eea407bdce4f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:35.811616 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-cf17df8d-f30e-454c-b702-eea407bdce4f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:35.812089 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-cf17df8d-f30e-454c-b702-eea407bdce4f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:35.896163 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-cf17df8d-f30e-454c-b702-eea407bdce4f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.097984 Jun 30 10:05:35.896725 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 320/661] 10.222.0.16 () {60 vars in 1315 bytes} [Thu Jun 30 10:05:35 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 10:05:37.079199 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-4136d44e-8d89-4f3c-a8ed-a75ce5b53160 req-976b3fae-aa1b-4e36-8ae5-05ff74fe1e18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ac05989-c74b-4ae8-90c2-b1c16bd45f87", "tag": "b21d9a4d-e7dc-4e74-9943-8abf6db35a29"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:05:37.087613 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-4136d44e-8d89-4f3c-a8ed-a75ce5b53160 req-976b3fae-aa1b-4e36-8ae5-05ff74fe1e18 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:37.088181 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-4136d44e-8d89-4f3c-a8ed-a75ce5b53160 req-976b3fae-aa1b-4e36-8ae5-05ff74fe1e18 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:37.100844 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-4136d44e-8d89-4f3c-a8ed-a75ce5b53160 req-976b3fae-aa1b-4e36-8ae5-05ff74fe1e18 service nova] Creating event network-changed:b21d9a4d-e7dc-4e74-9943-8abf6db35a29 for instance 4ac05989-c74b-4ae8-90c2-b1c16bd45f87 on hv-cinder-84330 Jun 30 10:05:37.108451 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-4136d44e-8d89-4f3c-a8ed-a75ce5b53160 req-976b3fae-aa1b-4e36-8ae5-05ff74fe1e18 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032742 Jun 30 10:05:37.109042 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 342/662] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:05:45.717642 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-b4b81c79-7364-4512-a58b-9c017abdf43b tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1170579311"}} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:05:45.718172 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-b4b81c79-7364-4512-a58b-9c017abdf43b tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:45.724504 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b4b81c79-7364-4512-a58b-9c017abdf43b tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:45.724938 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b4b81c79-7364-4512-a58b-9c017abdf43b tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:45.725694 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b4b81c79-7364-4512-a58b-9c017abdf43b tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:45.726232 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b4b81c79-7364-4512-a58b-9c017abdf43b tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:45.950895 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.network.security_group_api [None req-b4b81c79-7364-4512-a58b-9c017abdf43b tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Removing security group 81cc7bba-9c83-417c-b750-cfc4d925531b from port 5b398ce3-4e1d-45ae-9288-26bcecde73b3 Jun 30 10:05:46.452572 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-b4b81c79-7364-4512-a58b-9c017abdf43b tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "POST /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be/action" status: 202 len: 0 microversion: 2.1 time: 0.739637 Jun 30 10:05:46.457107 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 321/663] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Jun 30 10:05:45 2022] POST /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be/action => generated 0 bytes in 742 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:05:46.460662 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-92c73cbc-2da4-4c9b-aa56-ec30a3ffdfc4 req-28bd0aec-6982-4cf4-aff1-d505b3f131da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2766477-90ca-46bc-b411-a2d1b06b01be", "tag": "5b398ce3-4e1d-45ae-9288-26bcecde73b3"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:05:46.465169 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:05:46.480300 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-92c73cbc-2da4-4c9b-aa56-ec30a3ffdfc4 req-28bd0aec-6982-4cf4-aff1-d505b3f131da service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:46.482090 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-92c73cbc-2da4-4c9b-aa56-ec30a3ffdfc4 req-28bd0aec-6982-4cf4-aff1-d505b3f131da service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:46.510812 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-92c73cbc-2da4-4c9b-aa56-ec30a3ffdfc4 req-28bd0aec-6982-4cf4-aff1-d505b3f131da service nova] Creating event network-changed:5b398ce3-4e1d-45ae-9288-26bcecde73b3 for instance e2766477-90ca-46bc-b411-a2d1b06b01be on hv-cinder-84330 Jun 30 10:05:46.519258 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-92c73cbc-2da4-4c9b-aa56-ec30a3ffdfc4 req-28bd0aec-6982-4cf4-aff1-d505b3f131da service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064061 Jun 30 10:05:46.521351 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 343/664] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:05:48.103695 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-2c8f9fa6-5434-425e-9e15-3ae2f1067118 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:48.105449 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-2c8f9fa6-5434-425e-9e15-3ae2f1067118 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:48.126759 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2c8f9fa6-5434-425e-9e15-3ae2f1067118 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:48.127671 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2c8f9fa6-5434-425e-9e15-3ae2f1067118 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:48.128683 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2c8f9fa6-5434-425e-9e15-3ae2f1067118 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:48.129264 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2c8f9fa6-5434-425e-9e15-3ae2f1067118 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:48.134149 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell1:SELECT=100 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:05:48.261945 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.objects.instance [None req-2c8f9fa6-5434-425e-9e15-3ae2f1067118 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lazy-loading 'services' on Instance uuid e2766477-90ca-46bc-b411-a2d1b06b01be {{(pid=117847) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:05:48.382184 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-2c8f9fa6-5434-425e-9e15-3ae2f1067118 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be/os-volume_attachments/53965418-3b2f-4d48-9d7f-6dc46d07ce8c" status: 202 len: 0 microversion: 2.1 time: 0.287857 Jun 30 10:05:48.383486 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 322/665] 10.222.0.16 () {58 vars in 1415 bytes} [Thu Jun 30 10:05:48 2022] DELETE /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be/os-volume_attachments/53965418-3b2f-4d48-9d7f-6dc46d07ce8c => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:05:48.405668 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-db58b1a8-d61b-43a4-9596-8f5973bcdfec tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:48.408150 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-db58b1a8-d61b-43a4-9596-8f5973bcdfec tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:48.428288 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-db58b1a8-d61b-43a4-9596-8f5973bcdfec tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:48.429233 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-db58b1a8-d61b-43a4-9596-8f5973bcdfec tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:48.431401 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-db58b1a8-d61b-43a4-9596-8f5973bcdfec tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:48.433060 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-db58b1a8-d61b-43a4-9596-8f5973bcdfec tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:48.492693 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-db58b1a8-d61b-43a4-9596-8f5973bcdfec tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097705 Jun 30 10:05:48.500051 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 344/666] 10.222.0.16 () {58 vars in 1301 bytes} [Thu Jun 30 10:05:48 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:05:48.541102 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [req-e92b5de5-13b2-4a56-a9de-432d761c3587 req-b3e9ca80-6cbe-45d1-9253-b2ff2bc586c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2766477-90ca-46bc-b411-a2d1b06b01be", "tag": "5b398ce3-4e1d-45ae-9288-26bcecde73b3"}]} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:05:48.558854 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_api:SELECT=40 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:05:48.561113 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-e92b5de5-13b2-4a56-a9de-432d761c3587 req-b3e9ca80-6cbe-45d1-9253-b2ff2bc586c6 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:48.561557 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-e92b5de5-13b2-4a56-a9de-432d761c3587 req-b3e9ca80-6cbe-45d1-9253-b2ff2bc586c6 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:48.579368 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.compute.server_external_events [req-e92b5de5-13b2-4a56-a9de-432d761c3587 req-b3e9ca80-6cbe-45d1-9253-b2ff2bc586c6 service nova] Creating event network-changed:5b398ce3-4e1d-45ae-9288-26bcecde73b3 for instance e2766477-90ca-46bc-b411-a2d1b06b01be on hv-cinder-84330 Jun 30 10:05:48.587078 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [req-e92b5de5-13b2-4a56-a9de-432d761c3587 req-b3e9ca80-6cbe-45d1-9253-b2ff2bc586c6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049544 Jun 30 10:05:48.590950 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 323/667] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:05:49.506493 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-6e2100d9-b091-4622-80e8-870887b64ef5 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:49.510165 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-6e2100d9-b091-4622-80e8-870887b64ef5 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:49.521305 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-6e2100d9-b091-4622-80e8-870887b64ef5 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:49.522593 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-6e2100d9-b091-4622-80e8-870887b64ef5 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:49.525658 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-6e2100d9-b091-4622-80e8-870887b64ef5 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:49.531298 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-6e2100d9-b091-4622-80e8-870887b64ef5 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:49.628162 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-6e2100d9-b091-4622-80e8-870887b64ef5 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.124527 Jun 30 10:05:49.635811 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 324/668] 10.222.0.16 () {58 vars in 1301 bytes} [Thu Jun 30 10:05:49 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be/os-volume_attachments => generated 25 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 10:05:49.649614 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-8ecaef1f-e2f7-49e5-8fcf-a9700f5ab6ec tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:49.650464 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-8ecaef1f-e2f7-49e5-8fcf-a9700f5ab6ec tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:49.672505 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8ecaef1f-e2f7-49e5-8fcf-a9700f5ab6ec tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:49.676132 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8ecaef1f-e2f7-49e5-8fcf-a9700f5ab6ec tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:49.677237 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8ecaef1f-e2f7-49e5-8fcf-a9700f5ab6ec tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:49.680766 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8ecaef1f-e2f7-49e5-8fcf-a9700f5ab6ec tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:49.727172 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-abc3c632-9f81-456e-ad70-2c8e9100ca9c tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:49.728370 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-abc3c632-9f81-456e-ad70-2c8e9100ca9c tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 83e934b3-db47-4ab2-a42e-252f5edb6cee] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:49.752387 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-abc3c632-9f81-456e-ad70-2c8e9100ca9c tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:49.753296 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-abc3c632-9f81-456e-ad70-2c8e9100ca9c tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:49.754495 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-abc3c632-9f81-456e-ad70-2c8e9100ca9c tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:49.755465 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-abc3c632-9f81-456e-ad70-2c8e9100ca9c tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:49.853953 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-abc3c632-9f81-456e-ad70-2c8e9100ca9c tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee/ips" status: 200 len: 151 microversion: 2.1 time: 0.409633 Jun 30 10:05:49.869675 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 345/669] 10.222.0.16 () {58 vars in 1247 bytes} [Thu Jun 30 10:05:49 2022] GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee/ips => generated 151 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:05:49.895907 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.wsgi [None req-8ecaef1f-e2f7-49e5-8fcf-a9700f5ab6ec tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] HTTP exception thrown: Instance e2766477-90ca-46bc-b411-a2d1b06b01be is not attached to volume 53965418-3b2f-4d48-9d7f-6dc46d07ce8c Jun 30 10:05:49.908114 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-8ecaef1f-e2f7-49e5-8fcf-a9700f5ab6ec tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Request method failure captured: Jun 30 10:05:49.908114 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: request: DELETE /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be/os-volume_attachments/53965418-3b2f-4d48-9d7f-6dc46d07ce8c HTTP/1.1 Jun 30 10:05:49.908114 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept: application/json Jun 30 10:05:49.908114 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept-Encoding: identity Jun 30 10:05:49.908114 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Connection: close Jun 30 10:05:49.908114 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Length: 0 Jun 30 10:05:49.908114 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Type: application/json Jun 30 10:05:49.908114 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Host: 10.222.0.16 Jun 30 10:05:49.908114 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Openstack-System-Scope: None Jun 30 10:05:49.908114 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: User-Agent: python-urllib3/1.26.9 Jun 30 10:05:49.908114 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Auth-Token: gAAAAABivXSmURE70GQfA-DNabcY8ao8clYO0z_e0rzCF_HXZDLg7CfQqdSh7kI_SyrgIVredWEpjUJfcqVBNARKNNhh3xjqakAPEkMmNkt4_KGHIohcHAselKqQ1URxuSbz-EP33sIawvm_YlONhw2u_KNQWcClKrjd1t203DJHtevsVTMUF_4 Jun 30 10:05:49.908114 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Id: None Jun 30 10:05:49.908114 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Name: None Jun 30 10:05:49.908114 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Identity-Status: Confirmed Jun 30 10:05:49.908114 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Is-Admin-Project: True Jun 30 10:05:49.908114 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Id: default Jun 30 10:05:49.908114 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Name: Default Jun 30 10:05:49.908114 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Id: d589375d668e413d839c63b0c3d4f104 Jun 30 10:05:49.908114 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Name: tempest-TestMinimumBasicScenario-1413344119 Jun 30 10:05:49.908114 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Role: reader,member Jun 30 10:05:49.908114 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Roles: reader,member Jun 30 10:05:49.909502 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d589375d668e413d839c63b0c3d4f104"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d589375d668e413d839c63b0c3d4f104"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d589375d668e413d839c63b0c3d4f104"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d589375d668e413d839c63b0c3d4f104"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:05:49.909502 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant: tempest-TestMinimumBasicScenario-1413344119 Jun 30 10:05:49.909502 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Id: d589375d668e413d839c63b0c3d4f104 Jun 30 10:05:49.909502 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1413344119 Jun 30 10:05:49.909502 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User: tempest-TestMinimumBasicScenario-1413344119-project Jun 30 10:05:49.909502 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Id: default Jun 30 10:05:49.909502 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Name: Default Jun 30 10:05:49.909502 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Id: aa782d84840842ef983ed058379d5626 Jun 30 10:05:49.909502 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Name: tempest-TestMinimumBasicScenario-1413344119-project Jun 30 10:05:49.909502 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: method: > Jun 30 10:05:49.909502 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: exception: Instance e2766477-90ca-46bc-b411-a2d1b06b01be is not attached to volume 53965418-3b2f-4d48-9d7f-6dc46d07ce8c Jun 30 10:05:49.910187 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: action_args: {'server_id': 'e2766477-90ca-46bc-b411-a2d1b06b01be', 'id': '53965418-3b2f-4d48-9d7f-6dc46d07ce8c'} Jun 30 10:05:49.910187 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:05:49.910187 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:05:49.910187 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 30 10:05:49.910187 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 30 10:05:49.910187 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 10:05:49.910187 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 10:05:49.910187 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 30 10:05:49.910187 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 30 10:05:49.910187 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 53965418-3b2f-4d48-9d7f-6dc46d07ce8c. Jun 30 10:05:49.910187 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:05:49.910187 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:05:49.910187 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:05:49.910187 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:05:49.910187 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:05:49.910187 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:05:49.910187 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:05:49.910187 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:05:49.910187 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:05:49.911321 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:05:49.911321 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 30 10:05:49.911321 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 30 10:05:49.911321 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2766477-90ca-46bc-b411-a2d1b06b01be is not attached to volume 53965418-3b2f-4d48-9d7f-6dc46d07ce8c Jun 30 10:05:49.911321 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:05:49.911321 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:05:49.911321 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:05:49.911321 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:05:49.911321 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:05:49.911321 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:05:49.911321 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:05:49.911321 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:05:49.911321 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2766477-90ca-46bc-b411-a2d1b06b01be is not attached to volume 53965418-3b2f-4d48-9d7f-6dc46d07ce8c Jun 30 10:05:49.911321 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:05:49.913527 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-8ecaef1f-e2f7-49e5-8fcf-a9700f5ab6ec tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Returning 404 to user: Instance e2766477-90ca-46bc-b411-a2d1b06b01be is not attached to volume 53965418-3b2f-4d48-9d7f-6dc46d07ce8c {{(pid=117847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:05:49.914834 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-8ecaef1f-e2f7-49e5-8fcf-a9700f5ab6ec tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be/os-volume_attachments/53965418-3b2f-4d48-9d7f-6dc46d07ce8c" status: 404 len: 154 microversion: 2.1 time: 0.277391 Jun 30 10:05:49.917209 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 325/670] 10.222.0.16 () {58 vars in 1415 bytes} [Thu Jun 30 10:05:49 2022] DELETE /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be/os-volume_attachments/53965418-3b2f-4d48-9d7f-6dc46d07ce8c => generated 154 bytes in 280 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:05:50.951967 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e9bdb29c-38cb-4a0d-95a1-ec16bfafc340 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Action: 'create', calling method: .version_select at 0x7fc220316700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-121302753", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlDxlRQI7mAjkriEl7s/NES0eAe0D7WThXI8k9s4Nm/HnUsAriPlJrjbAaU4jRuszsOoh+nTVykX6josFJ55kY66u8jY+9gMYWAEk+xq24/FJaPjdm/YSWUI/Q5rC4vVw=="}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:05:50.967450 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-e9bdb29c-38cb-4a0d-95a1-ec16bfafc340 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Getting quotas for project 108ee256fba04d1b83fe00c166742f0b. Resources: {'key_pairs'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:05:50.971938 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-e9bdb29c-38cb-4a0d-95a1-ec16bfafc340 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Getting quotas for user ead8ee09f8514e75882c877042764a92 and project 108ee256fba04d1b83fe00c166742f0b. Resources: {'key_pairs'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:05:51.005238 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-e9bdb29c-38cb-4a0d-95a1-ec16bfafc340 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.156068 Jun 30 10:05:51.044978 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 346/671] 10.222.0.16 () {60 vars in 1158 bytes} [Thu Jun 30 10:05:50 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:05:51.180428 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-a4eedf81-af6c-49ad-8e59-f585e01b410c tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:51.181028 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-a4eedf81-af6c-49ad-8e59-f585e01b410c tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:51.187832 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a4eedf81-af6c-49ad-8e59-f585e01b410c tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:51.188913 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a4eedf81-af6c-49ad-8e59-f585e01b410c tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:51.189836 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a4eedf81-af6c-49ad-8e59-f585e01b410c tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:51.190264 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a4eedf81-af6c-49ad-8e59-f585e01b410c tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:51.243289 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-a4eedf81-af6c-49ad-8e59-f585e01b410c tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Going to try to terminate instance {{(pid=117847) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 10:05:51.380457 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-a4eedf81-af6c-49ad-8e59-f585e01b410c tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 204 len: 0 microversion: 2.1 time: 0.209329 Jun 30 10:05:51.381874 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 326/672] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 10:05:51 2022] DELETE /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 10:05:51.391292 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-952a8d00-85f4-4edb-ba92-365e8a2e1b98 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:51.392494 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-952a8d00-85f4-4edb-ba92-365e8a2e1b98 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:51.405954 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-952a8d00-85f4-4edb-ba92-365e8a2e1b98 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:51.406406 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-952a8d00-85f4-4edb-ba92-365e8a2e1b98 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:51.407289 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-952a8d00-85f4-4edb-ba92-365e8a2e1b98 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:51.407716 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-952a8d00-85f4-4edb-ba92-365e8a2e1b98 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:51.511462 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-a0f8b42a-164f-43b7-8edc-cee8f0d485fe tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c97bc70a-af36-4679-8b6f-b664d43b8fc0"}} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:05:51.512824 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-a0f8b42a-164f-43b7-8edc-cee8f0d485fe tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 83e934b3-db47-4ab2-a42e-252f5edb6cee] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:51.523644 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a0f8b42a-164f-43b7-8edc-cee8f0d485fe tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:51.528747 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a0f8b42a-164f-43b7-8edc-cee8f0d485fe tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:51.530770 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a0f8b42a-164f-43b7-8edc-cee8f0d485fe tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:51.531434 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a0f8b42a-164f-43b7-8edc-cee8f0d485fe tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:51.677879 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-952a8d00-85f4-4edb-ba92-365e8a2e1b98 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:51.690396 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-952a8d00-85f4-4edb-ba92-365e8a2e1b98 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1554 microversion: 2.1 time: 0.303436 Jun 30 10:05:51.691269 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 347/673] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:51 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1554 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:05:52.710208 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-2b4b8632-0b13-410b-bb5e-82e66e57637f tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:52.712344 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-2b4b8632-0b13-410b-bb5e-82e66e57637f tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:52.720719 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2b4b8632-0b13-410b-bb5e-82e66e57637f tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:52.721163 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2b4b8632-0b13-410b-bb5e-82e66e57637f tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:52.722109 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2b4b8632-0b13-410b-bb5e-82e66e57637f tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:52.722547 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2b4b8632-0b13-410b-bb5e-82e66e57637f tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:52.873393 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-2b4b8632-0b13-410b-bb5e-82e66e57637f tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:52.886122 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-2b4b8632-0b13-410b-bb5e-82e66e57637f tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1554 microversion: 2.1 time: 0.180027 Jun 30 10:05:52.887344 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 348/674] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:52 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1554 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:05:53.271035 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-a0f8b42a-164f-43b7-8edc-cee8f0d485fe tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "POST /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.763962 Jun 30 10:05:53.276178 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 327/675] 10.222.0.16 () {60 vars in 1322 bytes} [Thu Jun 30 10:05:51 2022] POST /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee/os-volume_attachments => generated 194 bytes in 1766 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:05:53.906053 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-985eb175-e2c2-46ec-96a2-7fc70badd78f tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:53.906676 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-985eb175-e2c2-46ec-96a2-7fc70badd78f tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:53.913109 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-985eb175-e2c2-46ec-96a2-7fc70badd78f tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:53.913557 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-985eb175-e2c2-46ec-96a2-7fc70badd78f tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:53.914364 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-985eb175-e2c2-46ec-96a2-7fc70badd78f tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:53.914971 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-985eb175-e2c2-46ec-96a2-7fc70badd78f tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:53.997055 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-985eb175-e2c2-46ec-96a2-7fc70badd78f tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa782d84840842ef983ed058379d5626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd589375d668e413d839c63b0c3d4f104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:05:54.004946 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-985eb175-e2c2-46ec-96a2-7fc70badd78f tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 200 len: 1512 microversion: 2.1 time: 0.103895 Jun 30 10:05:54.005667 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 349/676] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:53 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 1512 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:05:54.028507 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [req-55947912-5695-441b-b0e8-0484ffe2aa56 req-86d5d219-faf2-4909-9a67-ad3e4fa807a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2766477-90ca-46bc-b411-a2d1b06b01be", "name": "network-vif-deleted", "tag": "5b398ce3-4e1d-45ae-9288-26bcecde73b3"}]} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:05:54.037199 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-55947912-5695-441b-b0e8-0484ffe2aa56 req-86d5d219-faf2-4909-9a67-ad3e4fa807a5 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:54.037632 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-55947912-5695-441b-b0e8-0484ffe2aa56 req-86d5d219-faf2-4909-9a67-ad3e4fa807a5 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:54.050974 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.compute.server_external_events [req-55947912-5695-441b-b0e8-0484ffe2aa56 req-86d5d219-faf2-4909-9a67-ad3e4fa807a5 service nova] Creating event network-vif-deleted:5b398ce3-4e1d-45ae-9288-26bcecde73b3 for instance e2766477-90ca-46bc-b411-a2d1b06b01be on hv-cinder-84330 Jun 30 10:05:54.057804 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [req-55947912-5695-441b-b0e8-0484ffe2aa56 req-86d5d219-faf2-4909-9a67-ad3e4fa807a5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102188 Jun 30 10:05:54.058437 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 328/677] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:05:55.022227 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-04cbafd8-4138-44b5-b428-3633cce09d60 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:55.022822 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-04cbafd8-4138-44b5-b428-3633cce09d60 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] [instance: e2766477-90ca-46bc-b411-a2d1b06b01be] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:05:55.030294 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-04cbafd8-4138-44b5-b428-3633cce09d60 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:55.030812 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-04cbafd8-4138-44b5-b428-3633cce09d60 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:55.031657 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-04cbafd8-4138-44b5-b428-3633cce09d60 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:05:55.032242 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-04cbafd8-4138-44b5-b428-3633cce09d60 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:05:55.046611 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-04cbafd8-4138-44b5-b428-3633cce09d60 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] HTTP exception thrown: Instance e2766477-90ca-46bc-b411-a2d1b06b01be could not be found. Jun 30 10:05:55.048645 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-04cbafd8-4138-44b5-b428-3633cce09d60 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Request method failure captured: Jun 30 10:05:55.048645 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: request: GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be HTTP/1.1 Jun 30 10:05:55.048645 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept: application/json Jun 30 10:05:55.048645 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jun 30 10:05:55.048645 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Connection: close Jun 30 10:05:55.048645 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jun 30 10:05:55.048645 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jun 30 10:05:55.048645 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Host: 10.222.0.16 Jun 30 10:05:55.048645 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jun 30 10:05:55.048645 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jun 30 10:05:55.048645 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABivXSmURE70GQfA-DNabcY8ao8clYO0z_e0rzCF_HXZDLg7CfQqdSh7kI_SyrgIVredWEpjUJfcqVBNARKNNhh3xjqakAPEkMmNkt4_KGHIohcHAselKqQ1URxuSbz-EP33sIawvm_YlONhw2u_KNQWcClKrjd1t203DJHtevsVTMUF_4 Jun 30 10:05:55.048645 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jun 30 10:05:55.048645 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jun 30 10:05:55.048645 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jun 30 10:05:55.048645 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jun 30 10:05:55.048645 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jun 30 10:05:55.048645 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jun 30 10:05:55.048645 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Id: d589375d668e413d839c63b0c3d4f104 Jun 30 10:05:55.048645 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-TestMinimumBasicScenario-1413344119 Jun 30 10:05:55.048645 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Role: reader,member Jun 30 10:05:55.048645 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Roles: reader,member Jun 30 10:05:55.050270 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d589375d668e413d839c63b0c3d4f104"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d589375d668e413d839c63b0c3d4f104"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d589375d668e413d839c63b0c3d4f104"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d589375d668e413d839c63b0c3d4f104"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:05:55.050270 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-TestMinimumBasicScenario-1413344119 Jun 30 10:05:55.050270 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Id: d589375d668e413d839c63b0c3d4f104 Jun 30 10:05:55.050270 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1413344119 Jun 30 10:05:55.050270 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User: tempest-TestMinimumBasicScenario-1413344119-project Jun 30 10:05:55.050270 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jun 30 10:05:55.050270 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jun 30 10:05:55.050270 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Id: aa782d84840842ef983ed058379d5626 Jun 30 10:05:55.050270 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-TestMinimumBasicScenario-1413344119-project Jun 30 10:05:55.050270 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: method: > Jun 30 10:05:55.050270 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: exception: Instance e2766477-90ca-46bc-b411-a2d1b06b01be could not be found. Jun 30 10:05:55.050270 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: action_args: {'id': 'e2766477-90ca-46bc-b411-a2d1b06b01be'} Jun 30 10:05:55.051217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:05:55.051217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:05:55.051217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:05:55.051217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:05:55.051217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:05:55.051217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:05:55.051217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:05:55.051217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:05:55.051217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:05:55.051217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:05:55.051217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2766477-90ca-46bc-b411-a2d1b06b01be could not be found. Jun 30 10:05:55.051217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:05:55.051217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:05:55.051217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:05:55.051217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:05:55.051217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:05:55.051217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:05:55.051217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:05:55.051217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:05:55.051217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:05:55.052814 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:05:55.052814 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:05:55.052814 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:05:55.052814 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:05:55.052814 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:05:55.052814 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:05:55.052814 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:05:55.052814 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2766477-90ca-46bc-b411-a2d1b06b01be could not be found. Jun 30 10:05:55.052814 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:05:55.052814 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:05:55.052814 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:05:55.052814 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:05:55.052814 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:05:55.052814 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:05:55.052814 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:05:55.052814 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:05:55.052814 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2766477-90ca-46bc-b411-a2d1b06b01be could not be found. Jun 30 10:05:55.052814 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:05:55.054151 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-04cbafd8-4138-44b5-b428-3633cce09d60 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Returning 404 to user: Instance e2766477-90ca-46bc-b411-a2d1b06b01be could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:05:55.054151 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-04cbafd8-4138-44b5-b428-3633cce09d60 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be" status: 404 len: 111 microversion: 2.1 time: 0.031770 Jun 30 10:05:55.054151 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 350/678] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:05:55 2022] GET /compute/v2.1/servers/e2766477-90ca-46bc-b411-a2d1b06b01be => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:05:55.060074 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-4140682f-5cbd-423e-acbc-9b99af85b2c1 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] Calling method '.version_select at 0x7fc2203b3700>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:05:55.085350 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-4140682f-5cbd-423e-acbc-9b99af85b2c1 tempest-TestMinimumBasicScenario-1413344119 tempest-TestMinimumBasicScenario-1413344119-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1062899002" status: 202 len: 0 microversion: 2.1 time: 0.030088 Jun 30 10:05:55.085967 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 329/679] 10.222.0.16 () {58 vars in 1271 bytes} [Thu Jun 30 10:05:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1062899002 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:06:00.861923 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-60ab47bd-e401-434d-988e-705f16ac53f4 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c97bc70a-af36-4679-8b6f-b664d43b8fc0"}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:06:00.863783 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-60ab47bd-e401-434d-988e-705f16ac53f4 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 83e934b3-db47-4ab2-a42e-252f5edb6cee] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:00.870444 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-60ab47bd-e401-434d-988e-705f16ac53f4 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:00.871126 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-60ab47bd-e401-434d-988e-705f16ac53f4 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:00.871644 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-60ab47bd-e401-434d-988e-705f16ac53f4 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:00.872281 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-60ab47bd-e401-434d-988e-705f16ac53f4 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:00.956625 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-60ab47bd-e401-434d-988e-705f16ac53f4 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] HTTP exception thrown: Invalid volume: volume c97bc70a-af36-4679-8b6f-b664d43b8fc0 is already attached to instances: 83e934b3-db47-4ab2-a42e-252f5edb6cee Jun 30 10:06:00.958458 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-60ab47bd-e401-434d-988e-705f16ac53f4 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Request method failure captured: Jun 30 10:06:00.958458 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: request: POST /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee/os-volume_attachments HTTP/1.1 Jun 30 10:06:00.958458 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept: application/json Jun 30 10:06:00.958458 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jun 30 10:06:00.958458 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Connection: close Jun 30 10:06:00.958458 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Length: 74 Jun 30 10:06:00.958458 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jun 30 10:06:00.958458 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Host: 10.222.0.16 Jun 30 10:06:00.958458 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jun 30 10:06:00.958458 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jun 30 10:06:00.958458 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABivXRKWOm8okSqawQyEyFIlPPo5ED3-MkteEmCjIwaTuHRpOC0yz7t-S9pF6F_OHxcNFTgq2ZVvCBW8WpcDzubzrkM7lZXCNWSzcj1P8TCpyHfDpEvKKwyetYBPaKEvw3fBqcARKuB5F-oWIrvkHJpnEC8cyolAJOOfEpEG7HP2E8WCR8 Jun 30 10:06:00.958458 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jun 30 10:06:00.958458 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jun 30 10:06:00.958458 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jun 30 10:06:00.958458 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jun 30 10:06:00.958458 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jun 30 10:06:00.958458 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jun 30 10:06:00.958458 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Id: 2e55dd4580184f158efedbad5dc6e8fb Jun 30 10:06:00.958458 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-AttachVolumeNegativeTest-821277988 Jun 30 10:06:00.958458 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Role: reader,member Jun 30 10:06:00.958458 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Roles: reader,member Jun 30 10:06:00.960115 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:06:00.960115 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-AttachVolumeNegativeTest-821277988 Jun 30 10:06:00.960115 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 2e55dd4580184f158efedbad5dc6e8fb Jun 30 10:06:00.960115 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-821277988 Jun 30 10:06:00.960115 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User: tempest-AttachVolumeNegativeTest-821277988-project Jun 30 10:06:00.960115 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jun 30 10:06:00.960115 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jun 30 10:06:00.960115 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Id: 4e9ad2c4909c49a6b3df8ece333e70b5 Jun 30 10:06:00.960115 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-AttachVolumeNegativeTest-821277988-project Jun 30 10:06:00.960115 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Jun 30 10:06:00.960115 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: {"volumeAttachment": {"volumeId": "c97bc70a-af36-4679-8b6f-b664d43b8fc0"}} Jun 30 10:06:00.960115 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: method: > Jun 30 10:06:00.961184 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: exception: Invalid volume: volume c97bc70a-af36-4679-8b6f-b664d43b8fc0 is already attached to instances: 83e934b3-db47-4ab2-a42e-252f5edb6cee Jun 30 10:06:00.961184 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: action_args: {'server_id': '83e934b3-db47-4ab2-a42e-252f5edb6cee', 'body': {'volumeAttachment': {'volumeId': 'c97bc70a-af36-4679-8b6f-b664d43b8fc0'}}} Jun 30 10:06:00.961184 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:06:00.961184 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:06:00.961184 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 30 10:06:00.961184 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 30 10:06:00.961184 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 30 10:06:00.961184 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 30 10:06:00.961184 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 30 10:06:00.961184 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 30 10:06:00.961184 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 30 10:06:00.961184 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 30 10:06:00.961184 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 30 10:06:00.961184 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 30 10:06:00.961184 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c97bc70a-af36-4679-8b6f-b664d43b8fc0 is already attached to instances: 83e934b3-db47-4ab2-a42e-252f5edb6cee Jun 30 10:06:00.961184 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:06:00.961184 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:06:00.961184 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:06:00.961184 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:06:00.964321 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:06:00.964321 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:06:00.964321 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:06:00.964321 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:06:00.964321 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:06:00.964321 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:06:00.964321 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 10:06:00.964321 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 10:06:00.964321 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 10:06:00.964321 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 10:06:00.964321 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 10:06:00.964321 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 10:06:00.964321 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 30 10:06:00.964321 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 30 10:06:00.964321 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c97bc70a-af36-4679-8b6f-b664d43b8fc0 is already attached to instances: 83e934b3-db47-4ab2-a42e-252f5edb6cee Jun 30 10:06:00.964321 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:06:00.964321 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:06:00.964321 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:06:00.964321 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:06:00.964321 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:06:00.965667 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:06:00.965667 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:06:00.965667 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:06:00.965667 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c97bc70a-af36-4679-8b6f-b664d43b8fc0 is already attached to instances: 83e934b3-db47-4ab2-a42e-252f5edb6cee Jun 30 10:06:00.965667 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:06:00.965667 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-60ab47bd-e401-434d-988e-705f16ac53f4 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Returning 400 to user: Invalid volume: volume c97bc70a-af36-4679-8b6f-b664d43b8fc0 is already attached to instances: 83e934b3-db47-4ab2-a42e-252f5edb6cee {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:06:00.965667 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-60ab47bd-e401-434d-988e-705f16ac53f4 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "POST /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103206 Jun 30 10:06:00.965667 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 351/680] 10.222.0.16 () {60 vars in 1322 bytes} [Thu Jun 30 10:06:00 2022] POST /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 30 10:06:01.023128 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-57d9db28-17c2-4550-bd4b-6d37e2f0aeea tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:01.023668 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-57d9db28-17c2-4550-bd4b-6d37e2f0aeea tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 83e934b3-db47-4ab2-a42e-252f5edb6cee] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:01.030737 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-57d9db28-17c2-4550-bd4b-6d37e2f0aeea tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:01.031438 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-57d9db28-17c2-4550-bd4b-6d37e2f0aeea tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:01.032636 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-57d9db28-17c2-4550-bd4b-6d37e2f0aeea tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:01.033266 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-57d9db28-17c2-4550-bd4b-6d37e2f0aeea tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:01.287886 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.objects.instance [None req-57d9db28-17c2-4550-bd4b-6d37e2f0aeea tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lazy-loading 'services' on Instance uuid 83e934b3-db47-4ab2-a42e-252f5edb6cee {{(pid=117847) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:06:01.373579 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-57d9db28-17c2-4550-bd4b-6d37e2f0aeea tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "DELETE /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee/os-volume_attachments/c97bc70a-af36-4679-8b6f-b664d43b8fc0" status: 202 len: 0 microversion: 2.1 time: 0.353028 Jun 30 10:06:01.374474 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 330/681] 10.222.0.16 () {58 vars in 1415 bytes} [Thu Jun 30 10:06:01 2022] DELETE /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee/os-volume_attachments/c97bc70a-af36-4679-8b6f-b664d43b8fc0 => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:06:01.384006 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-0b5598fb-84f8-4eb6-af86-dee131b9d137 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:01.385414 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-0b5598fb-84f8-4eb6-af86-dee131b9d137 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 83e934b3-db47-4ab2-a42e-252f5edb6cee] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:01.392844 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=4 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:06:01.395392 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0b5598fb-84f8-4eb6-af86-dee131b9d137 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:01.396092 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0b5598fb-84f8-4eb6-af86-dee131b9d137 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:01.397855 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0b5598fb-84f8-4eb6-af86-dee131b9d137 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:01.398533 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0b5598fb-84f8-4eb6-af86-dee131b9d137 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:01.437313 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-0b5598fb-84f8-4eb6-af86-dee131b9d137 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057556 Jun 30 10:06:01.438895 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 352/682] 10.222.0.16 () {58 vars in 1301 bytes} [Thu Jun 30 10:06:01 2022] GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:06:02.451024 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-35835397-db5e-4202-a261-21f77604125b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:02.452140 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-35835397-db5e-4202-a261-21f77604125b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 83e934b3-db47-4ab2-a42e-252f5edb6cee] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:02.459608 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-35835397-db5e-4202-a261-21f77604125b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:02.459608 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-35835397-db5e-4202-a261-21f77604125b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:02.460779 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-35835397-db5e-4202-a261-21f77604125b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:02.461063 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-35835397-db5e-4202-a261-21f77604125b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:02.503009 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-35835397-db5e-4202-a261-21f77604125b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056448 Jun 30 10:06:02.503919 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 331/683] 10.222.0.16 () {58 vars in 1301 bytes} [Thu Jun 30 10:06:02 2022] GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 10:06:02.583330 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ad17d763-9e4d-41ef-a48f-ebe8b1884eba tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:02.584022 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-ad17d763-9e4d-41ef-a48f-ebe8b1884eba tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 83e934b3-db47-4ab2-a42e-252f5edb6cee] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:02.591992 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ad17d763-9e4d-41ef-a48f-ebe8b1884eba tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:02.593178 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ad17d763-9e4d-41ef-a48f-ebe8b1884eba tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:02.594343 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ad17d763-9e4d-41ef-a48f-ebe8b1884eba tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:02.595461 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ad17d763-9e4d-41ef-a48f-ebe8b1884eba tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:02.600243 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=66 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:06:02.628288 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-ad17d763-9e4d-41ef-a48f-ebe8b1884eba tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 83e934b3-db47-4ab2-a42e-252f5edb6cee] Going to try to terminate instance {{(pid=117846) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 10:06:02.765005 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ad17d763-9e4d-41ef-a48f-ebe8b1884eba tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "DELETE /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee" status: 204 len: 0 microversion: 2.1 time: 0.186561 Jun 30 10:06:02.765594 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 353/684] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 10:06:02 2022] DELETE /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 10:06:02.773805 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-d0c342f8-d183-4eae-820a-58da55ccc6df tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:02.774560 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-d0c342f8-d183-4eae-820a-58da55ccc6df tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 83e934b3-db47-4ab2-a42e-252f5edb6cee] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:02.780925 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d0c342f8-d183-4eae-820a-58da55ccc6df tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:02.781504 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d0c342f8-d183-4eae-820a-58da55ccc6df tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:02.782455 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d0c342f8-d183-4eae-820a-58da55ccc6df tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:02.782980 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d0c342f8-d183-4eae-820a-58da55ccc6df tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:03.011782 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-d0c342f8-d183-4eae-820a-58da55ccc6df tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:03.033725 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-d0c342f8-d183-4eae-820a-58da55ccc6df tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee" status: 200 len: 1681 microversion: 2.1 time: 0.263225 Jun 30 10:06:03.034631 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 332/685] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:02 2022] GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee => generated 1681 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:06:04.054880 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-db98f373-5079-4c49-82d1-c444ce0a52da tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:04.055680 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-db98f373-5079-4c49-82d1-c444ce0a52da tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 83e934b3-db47-4ab2-a42e-252f5edb6cee] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:04.064198 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-db98f373-5079-4c49-82d1-c444ce0a52da tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:04.064635 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-db98f373-5079-4c49-82d1-c444ce0a52da tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:04.065414 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-db98f373-5079-4c49-82d1-c444ce0a52da tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:04.065845 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-db98f373-5079-4c49-82d1-c444ce0a52da tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:04.212686 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-db98f373-5079-4c49-82d1-c444ce0a52da tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:04.222222 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-db98f373-5079-4c49-82d1-c444ce0a52da tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee" status: 200 len: 1681 microversion: 2.1 time: 0.175203 Jun 30 10:06:04.222984 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 354/686] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:04 2022] GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:05.240035 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-7d390d7c-5590-46c9-af60-87935203d25d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:05.240642 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-7d390d7c-5590-46c9-af60-87935203d25d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 83e934b3-db47-4ab2-a42e-252f5edb6cee] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:05.247534 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7d390d7c-5590-46c9-af60-87935203d25d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:05.248016 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7d390d7c-5590-46c9-af60-87935203d25d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:05.248781 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7d390d7c-5590-46c9-af60-87935203d25d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:05.249208 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7d390d7c-5590-46c9-af60-87935203d25d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:05.336142 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-7d390d7c-5590-46c9-af60-87935203d25d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:05.344005 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-7d390d7c-5590-46c9-af60-87935203d25d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee" status: 200 len: 1614 microversion: 2.1 time: 0.107847 Jun 30 10:06:05.344642 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 333/687] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:05 2022] GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee => generated 1614 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:05.425014 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-14f2cdfc-82d3-4e7b-ba29-23fb9af5e68c req-b58f2bf7-1270-4c96-9269-b0a9219294e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83e934b3-db47-4ab2-a42e-252f5edb6cee", "name": "network-vif-deleted", "tag": "2207973a-d23f-47ca-95f4-cd7d1c8e63af"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:06:05.433412 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-14f2cdfc-82d3-4e7b-ba29-23fb9af5e68c req-b58f2bf7-1270-4c96-9269-b0a9219294e0 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:05.433938 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-14f2cdfc-82d3-4e7b-ba29-23fb9af5e68c req-b58f2bf7-1270-4c96-9269-b0a9219294e0 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:05.460968 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-14f2cdfc-82d3-4e7b-ba29-23fb9af5e68c req-b58f2bf7-1270-4c96-9269-b0a9219294e0 service nova] Creating event network-vif-deleted:2207973a-d23f-47ca-95f4-cd7d1c8e63af for instance 83e934b3-db47-4ab2-a42e-252f5edb6cee on hv-cinder-84330 Jun 30 10:06:05.466626 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-14f2cdfc-82d3-4e7b-ba29-23fb9af5e68c req-b58f2bf7-1270-4c96-9269-b0a9219294e0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045346 Jun 30 10:06:05.467233 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 355/688] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:06:06.361559 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-2c0d2ee8-43d1-49ca-9ccc-b2b334639cf3 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:06.362122 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-2c0d2ee8-43d1-49ca-9ccc-b2b334639cf3 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 83e934b3-db47-4ab2-a42e-252f5edb6cee] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:06.369117 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2c0d2ee8-43d1-49ca-9ccc-b2b334639cf3 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:06.369667 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2c0d2ee8-43d1-49ca-9ccc-b2b334639cf3 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:06.370448 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2c0d2ee8-43d1-49ca-9ccc-b2b334639cf3 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:06.370872 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2c0d2ee8-43d1-49ca-9ccc-b2b334639cf3 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:06.385362 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.wsgi [None req-2c0d2ee8-43d1-49ca-9ccc-b2b334639cf3 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] HTTP exception thrown: Instance 83e934b3-db47-4ab2-a42e-252f5edb6cee could not be found. Jun 30 10:06:06.387054 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-2c0d2ee8-43d1-49ca-9ccc-b2b334639cf3 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Request method failure captured: Jun 30 10:06:06.387054 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: request: GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee HTTP/1.1 Jun 30 10:06:06.387054 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept: application/json Jun 30 10:06:06.387054 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept-Encoding: identity Jun 30 10:06:06.387054 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Connection: close Jun 30 10:06:06.387054 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Length: 0 Jun 30 10:06:06.387054 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Type: application/json Jun 30 10:06:06.387054 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Host: 10.222.0.16 Jun 30 10:06:06.387054 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Openstack-System-Scope: None Jun 30 10:06:06.387054 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: User-Agent: python-urllib3/1.26.9 Jun 30 10:06:06.387054 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Auth-Token: gAAAAABivXRKWOm8okSqawQyEyFIlPPo5ED3-MkteEmCjIwaTuHRpOC0yz7t-S9pF6F_OHxcNFTgq2ZVvCBW8WpcDzubzrkM7lZXCNWSzcj1P8TCpyHfDpEvKKwyetYBPaKEvw3fBqcARKuB5F-oWIrvkHJpnEC8cyolAJOOfEpEG7HP2E8WCR8 Jun 30 10:06:06.387054 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Id: None Jun 30 10:06:06.387054 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Name: None Jun 30 10:06:06.387054 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Identity-Status: Confirmed Jun 30 10:06:06.387054 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Is-Admin-Project: True Jun 30 10:06:06.387054 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Id: default Jun 30 10:06:06.387054 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Name: Default Jun 30 10:06:06.387054 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Id: 2e55dd4580184f158efedbad5dc6e8fb Jun 30 10:06:06.387054 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Name: tempest-AttachVolumeNegativeTest-821277988 Jun 30 10:06:06.387054 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Role: reader,member Jun 30 10:06:06.387054 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Roles: reader,member Jun 30 10:06:06.388595 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:06:06.388595 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant: tempest-AttachVolumeNegativeTest-821277988 Jun 30 10:06:06.388595 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Id: 2e55dd4580184f158efedbad5dc6e8fb Jun 30 10:06:06.388595 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-821277988 Jun 30 10:06:06.388595 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User: tempest-AttachVolumeNegativeTest-821277988-project Jun 30 10:06:06.388595 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Id: default Jun 30 10:06:06.388595 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Name: Default Jun 30 10:06:06.388595 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Id: 4e9ad2c4909c49a6b3df8ece333e70b5 Jun 30 10:06:06.388595 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Name: tempest-AttachVolumeNegativeTest-821277988-project Jun 30 10:06:06.388595 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: method: > Jun 30 10:06:06.388595 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: exception: Instance 83e934b3-db47-4ab2-a42e-252f5edb6cee could not be found. Jun 30 10:06:06.388595 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: action_args: {'id': '83e934b3-db47-4ab2-a42e-252f5edb6cee'} Jun 30 10:06:06.389536 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:06:06.389536 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:06:06.389536 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:06:06.389536 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:06:06.389536 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:06:06.389536 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:06:06.389536 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:06:06.389536 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:06:06.389536 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:06:06.389536 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:06:06.389536 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83e934b3-db47-4ab2-a42e-252f5edb6cee could not be found. Jun 30 10:06:06.389536 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:06:06.389536 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:06:06.389536 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:06:06.389536 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:06:06.389536 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:06:06.389536 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:06:06.389536 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:06:06.389536 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:06:06.389536 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:06:06.391002 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:06:06.391002 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:06:06.391002 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:06:06.391002 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:06:06.391002 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:06:06.391002 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:06:06.391002 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:06:06.391002 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83e934b3-db47-4ab2-a42e-252f5edb6cee could not be found. Jun 30 10:06:06.391002 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:06:06.391002 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:06:06.391002 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:06:06.391002 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:06:06.391002 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:06:06.391002 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:06:06.391002 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:06:06.391002 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:06:06.391002 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83e934b3-db47-4ab2-a42e-252f5edb6cee could not be found. Jun 30 10:06:06.391002 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:06:06.392414 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-2c0d2ee8-43d1-49ca-9ccc-b2b334639cf3 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Returning 404 to user: Instance 83e934b3-db47-4ab2-a42e-252f5edb6cee could not be found. {{(pid=117847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:06:06.392414 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-2c0d2ee8-43d1-49ca-9ccc-b2b334639cf3 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee" status: 404 len: 111 microversion: 2.1 time: 0.031100 Jun 30 10:06:06.392748 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 334/689] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:06 2022] GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:06:06.398732 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-0707e48d-6471-4161-bc29-585efdb1b025 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '.version_select at 0x7fc2202610d0>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:06.419446 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-0707e48d-6471-4161-bc29-585efdb1b025 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-992862654" status: 202 len: 0 microversion: 2.1 time: 0.025258 Jun 30 10:06:06.420253 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 356/690] 10.222.0.16 () {58 vars in 1217 bytes} [Thu Jun 30 10:06:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-992862654 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:06:07.285515 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-109a56fc-ed97-4b9c-999c-707a7f290024 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Action: 'create', calling method: .version_select at 0x7fc222be98b0>, body: {"keypair": {"name": "tempest-keypair-116394264", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIlsDYf4JaUb+iRuEsWa298CwgrutMoANgqztIcrFuv9bm3nZRixo/MpPlWqyipsVIC9wfNGUjnUF6Cl8nXzGjBXThcRdh94zuFUu7lYVd5F8+WvVXwpoCtTR848o4M/g=="}} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:06:07.302654 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.quota [None req-109a56fc-ed97-4b9c-999c-707a7f290024 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Getting quotas for project 2e55dd4580184f158efedbad5dc6e8fb. Resources: {'key_pairs'} {{(pid=117847) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:06:07.306741 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.quota [None req-109a56fc-ed97-4b9c-999c-707a7f290024 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Getting quotas for user 4e9ad2c4909c49a6b3df8ece333e70b5 and project 2e55dd4580184f158efedbad5dc6e8fb. Resources: {'key_pairs'} {{(pid=117847) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:06:07.330609 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-109a56fc-ed97-4b9c-999c-707a7f290024 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048928 Jun 30 10:06:07.331166 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 335/691] 10.222.0.16 () {60 vars in 1158 bytes} [Thu Jun 30 10:06:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:06:08.659846 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ed8c8582-c239-45ef-b4e4-4f5596e3a264 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1192370112", "imageRef": "c9dccba6-70d7-4aa8-9b8f-9c88ef1af443", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0141f079-f9f5-43fa-9ae7-09ea5e157c2e"}], "security_groups": [{"name": "tempest-securitygroup--1629251635"}], "key_name": "tempest-keypair-116394264", "user_data": "}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:06:08.760731 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.network.neutron [None req-ed8c8582-c239-45ef-b4e4-4f5596e3a264 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] validate_networks() for [('0141f079-f9f5-43fa-9ae7-09ea5e157c2e', None, None, None, None, None)] {{(pid=117846) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 10:06:09.149905 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-2c2a56af-6e7d-4f3b-8d20-5a484d73c758 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-572018417", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-121302753", "security_groups": [{"name": "tempest-secgroup-smoke-532297396"}], "block_device_mapping_v2": [{"uuid": "a359a1d5-81b5-4d24-aab1-fe1d537fcbf0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2b00bb97-ebc4-4ba6-81b4-d993140665ad"}]}} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:06:09.256160 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-ed8c8582-c239-45ef-b4e4-4f5596e3a264 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Flavor limits 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 10:06:09.256576 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-ed8c8582-c239-45ef-b4e4-4f5596e3a264 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Image limits 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 10:06:09.257066 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-ed8c8582-c239-45ef-b4e4-4f5596e3a264 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Flavor pref 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 10:06:09.257467 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-ed8c8582-c239-45ef-b4e4-4f5596e3a264 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Image pref 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 10:06:09.257864 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-ed8c8582-c239-45ef-b4e4-4f5596e3a264 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 10:06:09.268128 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ed8c8582-c239-45ef-b4e4-4f5596e3a264 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:09.268569 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ed8c8582-c239-45ef-b4e4-4f5596e3a264 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:09.269350 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ed8c8582-c239-45ef-b4e4-4f5596e3a264 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:09.269773 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ed8c8582-c239-45ef-b4e4-4f5596e3a264 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:09.280678 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.network.neutron [None req-2c2a56af-6e7d-4f3b-8d20-5a484d73c758 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] validate_networks() for [('2b00bb97-ebc4-4ba6-81b4-d993140665ad', None, None, None, None, None)] {{(pid=117847) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 10:06:09.288112 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-ed8c8582-c239-45ef-b4e4-4f5596e3a264 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Getting quotas for project 2e55dd4580184f158efedbad5dc6e8fb. Resources: {'ram', 'instances', 'cores'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:06:09.292355 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-ed8c8582-c239-45ef-b4e4-4f5596e3a264 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Getting quotas for user 4e9ad2c4909c49a6b3df8ece333e70b5 and project 2e55dd4580184f158efedbad5dc6e8fb. Resources: {'ram', 'instances', 'cores'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:06:09.304652 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-ed8c8582-c239-45ef-b4e4-4f5596e3a264 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Going to run 1 instances... {{(pid=117846) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 10:06:09.307006 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-ed8c8582-c239-45ef-b4e4-4f5596e3a264 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: cc0df4f5-54ea-46ae-837b-66e0a4c09443] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9dccba6-70d7-4aa8-9b8f-9c88ef1af443',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117846) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 10:06:09.356935 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ed8c8582-c239-45ef-b4e4-4f5596e3a264 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.701883 Jun 30 10:06:09.360023 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 357/692] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jun 30 10:06:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 10:06:09.368532 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-4e15daa2-0535-4673-891a-3e44d70d6c79 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:09.369159 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-4e15daa2-0535-4673-891a-3e44d70d6c79 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: cc0df4f5-54ea-46ae-837b-66e0a4c09443] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:09.436909 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-4e15daa2-0535-4673-891a-3e44d70d6c79 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:09.444734 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-4e15daa2-0535-4673-891a-3e44d70d6c79 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443" status: 200 len: 1241 microversion: 2.1 time: 0.080743 Jun 30 10:06:09.445430 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 358/693] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:09 2022] GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443 => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:09.728132 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-2c2a56af-6e7d-4f3b-8d20-5a484d73c758 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Flavor limits 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 10:06:09.728546 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-2c2a56af-6e7d-4f3b-8d20-5a484d73c758 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Image limits 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 10:06:09.729004 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-2c2a56af-6e7d-4f3b-8d20-5a484d73c758 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Flavor pref 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 10:06:09.729405 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-2c2a56af-6e7d-4f3b-8d20-5a484d73c758 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Image pref 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 10:06:09.729774 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-2c2a56af-6e7d-4f3b-8d20-5a484d73c758 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 10:06:09.740230 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2c2a56af-6e7d-4f3b-8d20-5a484d73c758 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:09.740672 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2c2a56af-6e7d-4f3b-8d20-5a484d73c758 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:09.741529 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2c2a56af-6e7d-4f3b-8d20-5a484d73c758 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:09.741963 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2c2a56af-6e7d-4f3b-8d20-5a484d73c758 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:09.760121 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.quota [None req-2c2a56af-6e7d-4f3b-8d20-5a484d73c758 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Getting quotas for project 108ee256fba04d1b83fe00c166742f0b. Resources: {'ram', 'instances', 'cores'} {{(pid=117847) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:06:09.764905 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.quota [None req-2c2a56af-6e7d-4f3b-8d20-5a484d73c758 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Getting quotas for user ead8ee09f8514e75882c877042764a92 and project 108ee256fba04d1b83fe00c166742f0b. Resources: {'ram', 'instances', 'cores'} {{(pid=117847) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:06:09.824657 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-2c2a56af-6e7d-4f3b-8d20-5a484d73c758 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Going to run 1 instances... {{(pid=117847) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 10:06:09.827144 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-2c2a56af-6e7d-4f3b-8d20-5a484d73c758 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 1802a0eb-4ac0-4939-b119-af84e90c5859] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a359a1d5-81b5-4d24-aab1-fe1d537fcbf0',volume_size=None,volume_type=None)] {{(pid=117847) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 10:06:09.963513 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-2c2a56af-6e7d-4f3b-8d20-5a484d73c758 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.817881 Jun 30 10:06:09.964543 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 336/694] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jun 30 10:06:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 10:06:09.974777 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-4830188a-0ecf-4727-bd2d-a7686fe9d780 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:09.975601 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-4830188a-0ecf-4727-bd2d-a7686fe9d780 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 1802a0eb-4ac0-4939-b119-af84e90c5859] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:10.038090 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-4830188a-0ecf-4727-bd2d-a7686fe9d780 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:10.045095 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-4830188a-0ecf-4727-bd2d-a7686fe9d780 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859" status: 200 len: 1093 microversion: 2.1 time: 0.074790 Jun 30 10:06:10.045737 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 359/695] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:09 2022] GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859 => generated 1093 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:10.462534 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-ebfb5d53-644e-49c2-a3c2-97753fdf1a3a tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:10.463265 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-ebfb5d53-644e-49c2-a3c2-97753fdf1a3a tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: cc0df4f5-54ea-46ae-837b-66e0a4c09443] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:10.469786 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ebfb5d53-644e-49c2-a3c2-97753fdf1a3a tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:10.470489 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ebfb5d53-644e-49c2-a3c2-97753fdf1a3a tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:10.471500 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ebfb5d53-644e-49c2-a3c2-97753fdf1a3a tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:10.472065 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ebfb5d53-644e-49c2-a3c2-97753fdf1a3a tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:10.550677 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-ebfb5d53-644e-49c2-a3c2-97753fdf1a3a tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:10.559530 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-ebfb5d53-644e-49c2-a3c2-97753fdf1a3a tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443" status: 200 len: 1301 microversion: 2.1 time: 0.101865 Jun 30 10:06:10.560412 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 337/696] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:10 2022] GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443 => generated 1301 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:11.063127 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-0ec9920a-63ef-4f8e-8d82-43d530164334 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:11.063692 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-0ec9920a-63ef-4f8e-8d82-43d530164334 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 1802a0eb-4ac0-4939-b119-af84e90c5859] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:11.077476 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0ec9920a-63ef-4f8e-8d82-43d530164334 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:11.077900 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0ec9920a-63ef-4f8e-8d82-43d530164334 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:11.078755 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0ec9920a-63ef-4f8e-8d82-43d530164334 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:11.079197 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0ec9920a-63ef-4f8e-8d82-43d530164334 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:11.337274 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-0ec9920a-63ef-4f8e-8d82-43d530164334 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:11.345429 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-0ec9920a-63ef-4f8e-8d82-43d530164334 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859" status: 200 len: 1199 microversion: 2.1 time: 0.286523 Jun 30 10:06:11.346019 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 360/697] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:11 2022] GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859 => generated 1199 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:11.578020 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-e13064b5-e91e-483d-927b-94a659ecbf8b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:11.578702 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-e13064b5-e91e-483d-927b-94a659ecbf8b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: cc0df4f5-54ea-46ae-837b-66e0a4c09443] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:11.591145 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e13064b5-e91e-483d-927b-94a659ecbf8b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:11.594046 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e13064b5-e91e-483d-927b-94a659ecbf8b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:11.595924 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e13064b5-e91e-483d-927b-94a659ecbf8b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:11.597050 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e13064b5-e91e-483d-927b-94a659ecbf8b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:11.809154 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-bdcf7771-d99d-49b6-b55d-f56631199904 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:11.809849 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-bdcf7771-d99d-49b6-b55d-f56631199904 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:11.816848 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bdcf7771-d99d-49b6-b55d-f56631199904 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:11.817384 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bdcf7771-d99d-49b6-b55d-f56631199904 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:11.818785 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bdcf7771-d99d-49b6-b55d-f56631199904 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:11.819318 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bdcf7771-d99d-49b6-b55d-f56631199904 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:11.903032 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.objects.instance [None req-bdcf7771-d99d-49b6-b55d-f56631199904 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lazy-loading 'services' on Instance uuid 114a9363-7f11-4906-959f-37a7d3275e52 {{(pid=117846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:06:11.962575 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-e13064b5-e91e-483d-927b-94a659ecbf8b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:11.971924 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-e13064b5-e91e-483d-927b-94a659ecbf8b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443" status: 200 len: 1367 microversion: 2.1 time: 0.398212 Jun 30 10:06:11.972789 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 338/698] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:11 2022] GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443 => generated 1367 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:11.979062 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-bdcf7771-d99d-49b6-b55d-f56631199904 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "DELETE /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52/os-volume_attachments/4cdac408-153b-4727-b5e0-3308a5cbe964" status: 202 len: 0 microversion: 2.1 time: 0.173626 Jun 30 10:06:11.979706 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 361/699] 10.222.0.16 () {58 vars in 1415 bytes} [Thu Jun 30 10:06:11 2022] DELETE /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52/os-volume_attachments/4cdac408-153b-4727-b5e0-3308a5cbe964 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:06:11.996018 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-edbc6cea-b670-4992-93dc-fbddb4bc1403 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:11.997429 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-edbc6cea-b670-4992-93dc-fbddb4bc1403 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:12.003810 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-edbc6cea-b670-4992-93dc-fbddb4bc1403 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:12.004281 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-edbc6cea-b670-4992-93dc-fbddb4bc1403 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:12.005274 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-edbc6cea-b670-4992-93dc-fbddb4bc1403 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:12.005703 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-edbc6cea-b670-4992-93dc-fbddb4bc1403 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:12.009906 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:06:12.039467 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-edbc6cea-b670-4992-93dc-fbddb4bc1403 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055403 Jun 30 10:06:12.040057 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 339/700] 10.222.0.16 () {58 vars in 1301 bytes} [Thu Jun 30 10:06:11 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:06:12.363972 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-58162956-7b56-4344-b79b-671ba250b474 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:12.364753 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-58162956-7b56-4344-b79b-671ba250b474 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 1802a0eb-4ac0-4939-b119-af84e90c5859] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:12.371457 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-58162956-7b56-4344-b79b-671ba250b474 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:12.372031 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-58162956-7b56-4344-b79b-671ba250b474 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:12.372798 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-58162956-7b56-4344-b79b-671ba250b474 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:12.373226 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-58162956-7b56-4344-b79b-671ba250b474 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:12.461901 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-58162956-7b56-4344-b79b-671ba250b474 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:12.469898 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-58162956-7b56-4344-b79b-671ba250b474 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859" status: 200 len: 1197 microversion: 2.1 time: 0.110804 Jun 30 10:06:12.470545 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 362/701] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:12 2022] GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859 => generated 1197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:12.973495 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [req-adfb6dfd-e5d2-4ab0-9731-4623943d84ff req-7b45bb0e-39ac-4df4-8a8a-06b4a3f21462 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc0df4f5-54ea-46ae-837b-66e0a4c09443", "tag": "c290f600-5bbc-467b-a453-efdf017e12bb"}]} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:06:12.989315 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-9a1bd21b-48b4-4fab-80e3-99f7a7ab3218 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:12.989918 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-9a1bd21b-48b4-4fab-80e3-99f7a7ab3218 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: cc0df4f5-54ea-46ae-837b-66e0a4c09443] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:13.003633 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-adfb6dfd-e5d2-4ab0-9731-4623943d84ff req-7b45bb0e-39ac-4df4-8a8a-06b4a3f21462 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:13.004499 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-adfb6dfd-e5d2-4ab0-9731-4623943d84ff req-7b45bb0e-39ac-4df4-8a8a-06b4a3f21462 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:13.007566 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9a1bd21b-48b4-4fab-80e3-99f7a7ab3218 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:13.008061 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9a1bd21b-48b4-4fab-80e3-99f7a7ab3218 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:13.008840 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9a1bd21b-48b4-4fab-80e3-99f7a7ab3218 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:13.009271 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9a1bd21b-48b4-4fab-80e3-99f7a7ab3218 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:13.025898 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.compute.server_external_events [req-adfb6dfd-e5d2-4ab0-9731-4623943d84ff req-7b45bb0e-39ac-4df4-8a8a-06b4a3f21462 service nova] Creating event network-changed:c290f600-5bbc-467b-a453-efdf017e12bb for instance cc0df4f5-54ea-46ae-837b-66e0a4c09443 on hv-cinder-84330 Jun 30 10:06:13.033916 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [req-adfb6dfd-e5d2-4ab0-9731-4623943d84ff req-7b45bb0e-39ac-4df4-8a8a-06b4a3f21462 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067648 Jun 30 10:06:13.035712 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 340/702] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:06:13.052579 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-16b7ec68-e15c-4f07-b5dd-4fe53d92c537 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:13.053889 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-16b7ec68-e15c-4f07-b5dd-4fe53d92c537 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:13.062383 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-16b7ec68-e15c-4f07-b5dd-4fe53d92c537 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:13.063389 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-16b7ec68-e15c-4f07-b5dd-4fe53d92c537 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:13.064313 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-16b7ec68-e15c-4f07-b5dd-4fe53d92c537 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:13.064832 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-16b7ec68-e15c-4f07-b5dd-4fe53d92c537 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:13.097648 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-16b7ec68-e15c-4f07-b5dd-4fe53d92c537 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049547 Jun 30 10:06:13.098214 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 341/703] 10.222.0.16 () {58 vars in 1301 bytes} [Thu Jun 30 10:06:13 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 10:06:13.171750 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-31ef123d-b2b2-4918-b019-c1117c46cd76 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:13.172478 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-31ef123d-b2b2-4918-b019-c1117c46cd76 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:13.179172 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-31ef123d-b2b2-4918-b019-c1117c46cd76 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:13.179898 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-31ef123d-b2b2-4918-b019-c1117c46cd76 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:13.180926 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-31ef123d-b2b2-4918-b019-c1117c46cd76 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:13.181451 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-31ef123d-b2b2-4918-b019-c1117c46cd76 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:13.206779 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-31ef123d-b2b2-4918-b019-c1117c46cd76 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Going to try to terminate instance {{(pid=117847) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 10:06:13.289555 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-31ef123d-b2b2-4918-b019-c1117c46cd76 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "DELETE /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 204 len: 0 microversion: 2.1 time: 0.121820 Jun 30 10:06:13.290399 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 342/704] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 10:06:13 2022] DELETE /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 10:06:13.298898 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-15c6d2d3-d752-4bf1-b182-30b782409fc9 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:13.299592 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-15c6d2d3-d752-4bf1-b182-30b782409fc9 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:13.305736 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-15c6d2d3-d752-4bf1-b182-30b782409fc9 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:13.306182 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-15c6d2d3-d752-4bf1-b182-30b782409fc9 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:13.306942 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-15c6d2d3-d752-4bf1-b182-30b782409fc9 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:13.307749 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-15c6d2d3-d752-4bf1-b182-30b782409fc9 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:13.431895 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-9a1bd21b-48b4-4fab-80e3-99f7a7ab3218 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:13.440533 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-9a1bd21b-48b4-4fab-80e3-99f7a7ab3218 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443" status: 200 len: 1367 microversion: 2.1 time: 0.455123 Jun 30 10:06:13.441192 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 363/705] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:12 2022] GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443 => generated 1367 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:13.486947 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-713f21ba-a3d4-43ab-888c-dbcad74ef6d5 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:13.487554 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-713f21ba-a3d4-43ab-888c-dbcad74ef6d5 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 1802a0eb-4ac0-4939-b119-af84e90c5859] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:13.493837 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-713f21ba-a3d4-43ab-888c-dbcad74ef6d5 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:13.494280 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-713f21ba-a3d4-43ab-888c-dbcad74ef6d5 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:13.495027 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-713f21ba-a3d4-43ab-888c-dbcad74ef6d5 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:13.495486 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-713f21ba-a3d4-43ab-888c-dbcad74ef6d5 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:13.595165 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-15c6d2d3-d752-4bf1-b182-30b782409fc9 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:13.603133 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-15c6d2d3-d752-4bf1-b182-30b782409fc9 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1690 microversion: 2.1 time: 0.308575 Jun 30 10:06:13.603727 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 343/706] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:13 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1690 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:13.716759 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-713f21ba-a3d4-43ab-888c-dbcad74ef6d5 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:13.727489 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-713f21ba-a3d4-43ab-888c-dbcad74ef6d5 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859" status: 200 len: 1264 microversion: 2.1 time: 0.244342 Jun 30 10:06:13.728202 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 364/707] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:13 2022] GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859 => generated 1264 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:14.461751 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-b1aa3098-9f2f-4ac9-9ba2-60bc0ffb501a tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:14.462863 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-b1aa3098-9f2f-4ac9-9ba2-60bc0ffb501a tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: cc0df4f5-54ea-46ae-837b-66e0a4c09443] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:14.472132 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b1aa3098-9f2f-4ac9-9ba2-60bc0ffb501a tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:14.472579 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b1aa3098-9f2f-4ac9-9ba2-60bc0ffb501a tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:14.473335 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b1aa3098-9f2f-4ac9-9ba2-60bc0ffb501a tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:14.473763 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b1aa3098-9f2f-4ac9-9ba2-60bc0ffb501a tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:14.620783 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-c88610f6-ea93-49da-b14a-affdbd5bf813 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:14.621401 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-c88610f6-ea93-49da-b14a-affdbd5bf813 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:14.622391 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-b1aa3098-9f2f-4ac9-9ba2-60bc0ffb501a tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:14.630577 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c88610f6-ea93-49da-b14a-affdbd5bf813 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:14.631101 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c88610f6-ea93-49da-b14a-affdbd5bf813 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:14.632130 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c88610f6-ea93-49da-b14a-affdbd5bf813 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:14.632783 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c88610f6-ea93-49da-b14a-affdbd5bf813 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:14.634099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-b1aa3098-9f2f-4ac9-9ba2-60bc0ffb501a tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443" status: 200 len: 1367 microversion: 2.1 time: 0.178805 Jun 30 10:06:14.634673 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 344/708] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:14 2022] GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:14.744016 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-c72ed850-2755-4b26-8d84-4f716d37d657 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:14.744627 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-c72ed850-2755-4b26-8d84-4f716d37d657 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 1802a0eb-4ac0-4939-b119-af84e90c5859] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:14.751199 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c72ed850-2755-4b26-8d84-4f716d37d657 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:14.751640 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c72ed850-2755-4b26-8d84-4f716d37d657 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:14.752436 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c72ed850-2755-4b26-8d84-4f716d37d657 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:14.752872 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c72ed850-2755-4b26-8d84-4f716d37d657 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:14.764093 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-c88610f6-ea93-49da-b14a-affdbd5bf813 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:14.772100 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-c88610f6-ea93-49da-b14a-affdbd5bf813 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1690 microversion: 2.1 time: 0.155375 Jun 30 10:06:14.772642 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 365/709] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:14 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:14.883436 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-c72ed850-2755-4b26-8d84-4f716d37d657 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:14.891921 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-c72ed850-2755-4b26-8d84-4f716d37d657 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859" status: 200 len: 1264 microversion: 2.1 time: 0.151755 Jun 30 10:06:14.892605 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 345/710] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:14 2022] GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:15.080840 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-d22feeee-5560-4520-8bc4-6ac40ee1ae55 req-14f710dc-978f-45a8-912e-c1839f2696ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1802a0eb-4ac0-4939-b119-af84e90c5859", "tag": "25a1c145-b1e0-489f-b51e-b65ee144d124"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:06:15.094883 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-d22feeee-5560-4520-8bc4-6ac40ee1ae55 req-14f710dc-978f-45a8-912e-c1839f2696ba service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:15.095346 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-d22feeee-5560-4520-8bc4-6ac40ee1ae55 req-14f710dc-978f-45a8-912e-c1839f2696ba service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:15.106364 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-d22feeee-5560-4520-8bc4-6ac40ee1ae55 req-14f710dc-978f-45a8-912e-c1839f2696ba service nova] Creating event network-changed:25a1c145-b1e0-489f-b51e-b65ee144d124 for instance 1802a0eb-4ac0-4939-b119-af84e90c5859 on hv-cinder-84330 Jun 30 10:06:15.111379 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-d22feeee-5560-4520-8bc4-6ac40ee1ae55 req-14f710dc-978f-45a8-912e-c1839f2696ba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036940 Jun 30 10:06:15.111945 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 366/711] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:06:15.654853 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-99017090-0909-42ec-b6c9-87d9673e1597 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:15.655950 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-99017090-0909-42ec-b6c9-87d9673e1597 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: cc0df4f5-54ea-46ae-837b-66e0a4c09443] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:15.667157 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-99017090-0909-42ec-b6c9-87d9673e1597 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:15.667836 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-99017090-0909-42ec-b6c9-87d9673e1597 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:15.669169 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-99017090-0909-42ec-b6c9-87d9673e1597 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:15.669876 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-99017090-0909-42ec-b6c9-87d9673e1597 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:15.789965 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-3ff306d5-7bf6-448a-b964-09f1baa3b3b0 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:15.790652 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-3ff306d5-7bf6-448a-b964-09f1baa3b3b0 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:15.797095 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3ff306d5-7bf6-448a-b964-09f1baa3b3b0 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:15.797549 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3ff306d5-7bf6-448a-b964-09f1baa3b3b0 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:15.798330 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3ff306d5-7bf6-448a-b964-09f1baa3b3b0 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:15.798759 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3ff306d5-7bf6-448a-b964-09f1baa3b3b0 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:15.813165 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-99017090-0909-42ec-b6c9-87d9673e1597 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:15.820991 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-99017090-0909-42ec-b6c9-87d9673e1597 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443" status: 200 len: 1367 microversion: 2.1 time: 0.172691 Jun 30 10:06:15.821595 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 346/712] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:15 2022] GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:15.910312 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-72e3d0aa-243f-49eb-a4f5-637ea0c2f9dd tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:15.910858 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-72e3d0aa-243f-49eb-a4f5-637ea0c2f9dd tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 1802a0eb-4ac0-4939-b119-af84e90c5859] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:15.917246 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-72e3d0aa-243f-49eb-a4f5-637ea0c2f9dd tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:15.917691 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-72e3d0aa-243f-49eb-a4f5-637ea0c2f9dd tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:15.918461 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-72e3d0aa-243f-49eb-a4f5-637ea0c2f9dd tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:15.918890 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-72e3d0aa-243f-49eb-a4f5-637ea0c2f9dd tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:15.954280 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-3ff306d5-7bf6-448a-b964-09f1baa3b3b0 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:15.962378 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-3ff306d5-7bf6-448a-b964-09f1baa3b3b0 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1690 microversion: 2.1 time: 0.177115 Jun 30 10:06:15.962966 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 367/713] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:15 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1690 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:16.056390 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-72e3d0aa-243f-49eb-a4f5-637ea0c2f9dd tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:16.065005 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-72e3d0aa-243f-49eb-a4f5-637ea0c2f9dd tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859" status: 200 len: 1264 microversion: 2.1 time: 0.159001 Jun 30 10:06:16.065589 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 347/714] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:15 2022] GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:16.837872 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-61845c7c-3180-48c2-8c0b-3b9c35a3cf20 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:16.838435 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-61845c7c-3180-48c2-8c0b-3b9c35a3cf20 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: cc0df4f5-54ea-46ae-837b-66e0a4c09443] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:16.841947 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:06:16.845921 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-61845c7c-3180-48c2-8c0b-3b9c35a3cf20 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:16.846367 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-61845c7c-3180-48c2-8c0b-3b9c35a3cf20 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:16.847132 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-61845c7c-3180-48c2-8c0b-3b9c35a3cf20 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:16.847546 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-61845c7c-3180-48c2-8c0b-3b9c35a3cf20 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:16.978991 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-494a554f-a071-477b-8c57-5d7d66961cd7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:16.979568 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-494a554f-a071-477b-8c57-5d7d66961cd7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:16.986883 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-494a554f-a071-477b-8c57-5d7d66961cd7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:16.987323 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-494a554f-a071-477b-8c57-5d7d66961cd7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:16.988125 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-494a554f-a071-477b-8c57-5d7d66961cd7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:16.988550 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-494a554f-a071-477b-8c57-5d7d66961cd7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:17.457504 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-494a554f-a071-477b-8c57-5d7d66961cd7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:17.465506 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-494a554f-a071-477b-8c57-5d7d66961cd7 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1690 microversion: 2.1 time: 0.490407 Jun 30 10:06:17.466329 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 348/715] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:16 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1690 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:17.469568 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-61845c7c-3180-48c2-8c0b-3b9c35a3cf20 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:17.477486 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-3c6d0c49-6c66-47d2-bf90-e8f065397971 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:17.478098 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-3c6d0c49-6c66-47d2-bf90-e8f065397971 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 1802a0eb-4ac0-4939-b119-af84e90c5859] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:17.478207 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-61845c7c-3180-48c2-8c0b-3b9c35a3cf20 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443" status: 200 len: 1367 microversion: 2.1 time: 0.644159 Jun 30 10:06:17.478859 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 368/716] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:16 2022] GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443 => generated 1367 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:17.484290 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3c6d0c49-6c66-47d2-bf90-e8f065397971 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:17.484829 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3c6d0c49-6c66-47d2-bf90-e8f065397971 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:17.485602 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3c6d0c49-6c66-47d2-bf90-e8f065397971 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:17.486035 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3c6d0c49-6c66-47d2-bf90-e8f065397971 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:17.717704 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-3c6d0c49-6c66-47d2-bf90-e8f065397971 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:17.725562 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-3c6d0c49-6c66-47d2-bf90-e8f065397971 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859" status: 200 len: 1264 microversion: 2.1 time: 0.251703 Jun 30 10:06:17.726376 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 349/717] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:17 2022] GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859 => generated 1264 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:18.335230 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-91374f1f-da4f-4f54-937a-0e6ba36a16c4 req-f42f14c3-1769-4a89-a6e1-d8e33169b753 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "114a9363-7f11-4906-959f-37a7d3275e52", "name": "network-vif-deleted", "tag": "290c2729-5bcd-422d-afde-63f591011bcf"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:06:18.354288 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-91374f1f-da4f-4f54-937a-0e6ba36a16c4 req-f42f14c3-1769-4a89-a6e1-d8e33169b753 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:18.354800 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-91374f1f-da4f-4f54-937a-0e6ba36a16c4 req-f42f14c3-1769-4a89-a6e1-d8e33169b753 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:18.380581 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-91374f1f-da4f-4f54-937a-0e6ba36a16c4 req-f42f14c3-1769-4a89-a6e1-d8e33169b753 service nova] Creating event network-vif-deleted:290c2729-5bcd-422d-afde-63f591011bcf for instance 114a9363-7f11-4906-959f-37a7d3275e52 on hv-cinder-84330 Jun 30 10:06:18.390519 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-91374f1f-da4f-4f54-937a-0e6ba36a16c4 req-f42f14c3-1769-4a89-a6e1-d8e33169b753 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059121 Jun 30 10:06:18.391127 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 369/718] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:06:18.482900 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-5498b60f-9b3e-457a-a955-fae58732a12d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:18.483668 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-5498b60f-9b3e-457a-a955-fae58732a12d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:18.491597 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-5498b60f-9b3e-457a-a955-fae58732a12d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:18.492178 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-5498b60f-9b3e-457a-a955-fae58732a12d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:18.493008 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-5498b60f-9b3e-457a-a955-fae58732a12d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:18.493501 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-5498b60f-9b3e-457a-a955-fae58732a12d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:18.494903 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-d6fee835-5c88-4ec7-9f03-69b174e415eb tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:18.495592 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-d6fee835-5c88-4ec7-9f03-69b174e415eb tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: cc0df4f5-54ea-46ae-837b-66e0a4c09443] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:18.502124 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d6fee835-5c88-4ec7-9f03-69b174e415eb tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:18.502852 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d6fee835-5c88-4ec7-9f03-69b174e415eb tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:18.503812 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d6fee835-5c88-4ec7-9f03-69b174e415eb tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:18.504461 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d6fee835-5c88-4ec7-9f03-69b174e415eb tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:18.532032 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-5498b60f-9b3e-457a-a955-fae58732a12d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:18.532475 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-5498b60f-9b3e-457a-a955-fae58732a12d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:18.532923 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.objects.instance [None req-5498b60f-9b3e-457a-a955-fae58732a12d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lazy-loading 'fault' on Instance uuid 114a9363-7f11-4906-959f-37a7d3275e52 {{(pid=117847) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:06:18.600084 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-5498b60f-9b3e-457a-a955-fae58732a12d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:18.608106 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-5498b60f-9b3e-457a-a955-fae58732a12d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 200 len: 1336 microversion: 2.1 time: 0.129201 Jun 30 10:06:18.608962 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 350/719] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:18 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 1336 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:18.669618 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-d6fee835-5c88-4ec7-9f03-69b174e415eb tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:18.680568 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-d6fee835-5c88-4ec7-9f03-69b174e415eb tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443" status: 200 len: 1367 microversion: 2.1 time: 0.189693 Jun 30 10:06:18.691548 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 370/720] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:18 2022] GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:06:18.743241 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-05e111c4-1bcb-485c-b68f-fabd6a32e286 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:18.749328 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-05e111c4-1bcb-485c-b68f-fabd6a32e286 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 1802a0eb-4ac0-4939-b119-af84e90c5859] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:18.752749 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:06:18.761023 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-05e111c4-1bcb-485c-b68f-fabd6a32e286 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:18.761999 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-05e111c4-1bcb-485c-b68f-fabd6a32e286 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:18.763025 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-05e111c4-1bcb-485c-b68f-fabd6a32e286 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:18.763688 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-05e111c4-1bcb-485c-b68f-fabd6a32e286 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:18.946809 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-05e111c4-1bcb-485c-b68f-fabd6a32e286 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:18.955934 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-05e111c4-1bcb-485c-b68f-fabd6a32e286 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859" status: 200 len: 1264 microversion: 2.1 time: 0.216536 Jun 30 10:06:18.956686 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 351/721] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:18 2022] GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859 => generated 1264 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:06:19.625274 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e2646d5c-be16-4972-b665-e923cc496eef tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:19.625933 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-e2646d5c-be16-4972-b665-e923cc496eef tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 114a9363-7f11-4906-959f-37a7d3275e52] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:19.628089 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=2 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:06:19.634807 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e2646d5c-be16-4972-b665-e923cc496eef tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:19.635329 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e2646d5c-be16-4972-b665-e923cc496eef tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:19.636196 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e2646d5c-be16-4972-b665-e923cc496eef tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:19.636669 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e2646d5c-be16-4972-b665-e923cc496eef tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:19.651859 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-e2646d5c-be16-4972-b665-e923cc496eef tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] HTTP exception thrown: Instance 114a9363-7f11-4906-959f-37a7d3275e52 could not be found. Jun 30 10:06:19.653670 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e2646d5c-be16-4972-b665-e923cc496eef tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Request method failure captured: Jun 30 10:06:19.653670 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: request: GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 HTTP/1.1 Jun 30 10:06:19.653670 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept: application/json Jun 30 10:06:19.653670 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jun 30 10:06:19.653670 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Connection: close Jun 30 10:06:19.653670 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jun 30 10:06:19.653670 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jun 30 10:06:19.653670 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Host: 10.222.0.16 Jun 30 10:06:19.653670 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jun 30 10:06:19.653670 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jun 30 10:06:19.653670 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABivXQ_-92o37DZs6KJkFkKOmwxkiwRqM5n-bwQzekE2akVqDN2T3UK3mXb5Q8vEgciD0-EZqDYHyMkNaHedrwR7kZ3VKOpjwe1q5N7_yLnQiQ9zWLbjXnQrmxPyI_YaSVtdEv4Ga6FaF9gEp45Vke44RdWPpPt0d1FP07cbOTc_eXjbzk Jun 30 10:06:19.653670 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jun 30 10:06:19.653670 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jun 30 10:06:19.653670 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jun 30 10:06:19.653670 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jun 30 10:06:19.653670 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jun 30 10:06:19.653670 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jun 30 10:06:19.653670 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Id: 0e8bc4e999ce4f1e9f52b456bcdd88d3 Jun 30 10:06:19.653670 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1274875426 Jun 30 10:06:19.653670 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Role: reader,member Jun 30 10:06:19.653670 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Roles: reader,member Jun 30 10:06:19.655439 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e8bc4e999ce4f1e9f52b456bcdd88d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0e8bc4e999ce4f1e9f52b456bcdd88d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e8bc4e999ce4f1e9f52b456bcdd88d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0e8bc4e999ce4f1e9f52b456bcdd88d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:06:19.655439 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1274875426 Jun 30 10:06:19.655439 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 0e8bc4e999ce4f1e9f52b456bcdd88d3 Jun 30 10:06:19.655439 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1274875426 Jun 30 10:06:19.655439 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User: tempest-ServerRescueNegativeTestJSON-1274875426-project Jun 30 10:06:19.655439 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jun 30 10:06:19.655439 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jun 30 10:06:19.655439 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Id: a179e34636ed4970be4f0790115f9d8f Jun 30 10:06:19.655439 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1274875426-project Jun 30 10:06:19.655439 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: method: > Jun 30 10:06:19.655439 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: exception: Instance 114a9363-7f11-4906-959f-37a7d3275e52 could not be found. Jun 30 10:06:19.655439 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: action_args: {'id': '114a9363-7f11-4906-959f-37a7d3275e52'} Jun 30 10:06:19.656456 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:06:19.656456 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:06:19.656456 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:06:19.656456 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:06:19.656456 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:06:19.656456 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:06:19.656456 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:06:19.656456 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:06:19.656456 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:06:19.656456 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:06:19.656456 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 114a9363-7f11-4906-959f-37a7d3275e52 could not be found. Jun 30 10:06:19.656456 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:06:19.656456 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:06:19.656456 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:06:19.656456 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:06:19.656456 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:06:19.656456 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:06:19.656456 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:06:19.656456 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:06:19.656456 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:06:19.657875 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:06:19.657875 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:06:19.657875 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:06:19.657875 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:06:19.657875 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:06:19.657875 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:06:19.657875 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:06:19.657875 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 114a9363-7f11-4906-959f-37a7d3275e52 could not be found. Jun 30 10:06:19.657875 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:06:19.657875 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:06:19.657875 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:06:19.657875 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:06:19.657875 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:06:19.657875 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:06:19.657875 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:06:19.657875 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:06:19.657875 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 114a9363-7f11-4906-959f-37a7d3275e52 could not be found. Jun 30 10:06:19.657875 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:06:19.659266 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e2646d5c-be16-4972-b665-e923cc496eef tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Returning 404 to user: Instance 114a9363-7f11-4906-959f-37a7d3275e52 could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:06:19.659266 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-e2646d5c-be16-4972-b665-e923cc496eef tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52" status: 404 len: 111 microversion: 2.1 time: 0.034267 Jun 30 10:06:19.659266 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 371/722] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:19 2022] GET /compute/v2.1/servers/114a9363-7f11-4906-959f-37a7d3275e52 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:06:19.664331 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-9e9ce19d-8dc7-4f67-9f91-f2c684c82319 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '.version_select at 0x7fc220502af0>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:19.684488 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-9e9ce19d-8dc7-4f67-9f91-f2c684c82319 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1971290745" status: 202 len: 0 microversion: 2.1 time: 0.023992 Jun 30 10:06:19.685070 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 352/723] 10.222.0.16 () {58 vars in 1220 bytes} [Thu Jun 30 10:06:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1971290745 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:06:19.698788 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-842762b4-0aec-46a2-bbf6-bb6c8e81bf81 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:19.699472 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-842762b4-0aec-46a2-bbf6-bb6c8e81bf81 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: cc0df4f5-54ea-46ae-837b-66e0a4c09443] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:19.705679 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-842762b4-0aec-46a2-bbf6-bb6c8e81bf81 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:19.706114 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-842762b4-0aec-46a2-bbf6-bb6c8e81bf81 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:19.706864 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-842762b4-0aec-46a2-bbf6-bb6c8e81bf81 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:19.707287 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-842762b4-0aec-46a2-bbf6-bb6c8e81bf81 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:19.855420 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-842762b4-0aec-46a2-bbf6-bb6c8e81bf81 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:19.861945 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-842762b4-0aec-46a2-bbf6-bb6c8e81bf81 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443" status: 200 len: 1367 microversion: 2.1 time: 0.166949 Jun 30 10:06:19.863506 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 372/724] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:19 2022] GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:19.970493 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell0:SELECT=2 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:06:19.971256 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell0:SELECT=10 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:06:19.975640 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-aada57ca-3833-4a15-9833-995424005bed tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:19.976107 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-aada57ca-3833-4a15-9833-995424005bed tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 1802a0eb-4ac0-4939-b119-af84e90c5859] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:19.983538 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-aada57ca-3833-4a15-9833-995424005bed tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:19.984084 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-aada57ca-3833-4a15-9833-995424005bed tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:19.984848 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-aada57ca-3833-4a15-9833-995424005bed tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:19.985368 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-aada57ca-3833-4a15-9833-995424005bed tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:20.207820 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-aada57ca-3833-4a15-9833-995424005bed tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:20.215558 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-aada57ca-3833-4a15-9833-995424005bed tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859" status: 200 len: 1264 microversion: 2.1 time: 0.245815 Jun 30 10:06:20.216182 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 353/725] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:19 2022] GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859 => generated 1264 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:20.790954 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=10 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:06:20.878847 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-87956da1-c948-4819-857e-6a5481b05598 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:20.879785 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-87956da1-c948-4819-857e-6a5481b05598 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: cc0df4f5-54ea-46ae-837b-66e0a4c09443] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:20.886854 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-87956da1-c948-4819-857e-6a5481b05598 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:20.887365 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-87956da1-c948-4819-857e-6a5481b05598 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:20.888261 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-87956da1-c948-4819-857e-6a5481b05598 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:20.888937 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-87956da1-c948-4819-857e-6a5481b05598 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:20.966539 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-68e153ac-e9cf-4097-a586-aa147d6adbcf tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:20.967115 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-68e153ac-e9cf-4097-a586-aa147d6adbcf tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:20.974147 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-68e153ac-e9cf-4097-a586-aa147d6adbcf tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:20.974583 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-68e153ac-e9cf-4097-a586-aa147d6adbcf tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:20.975366 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-68e153ac-e9cf-4097-a586-aa147d6adbcf tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:20.975795 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-68e153ac-e9cf-4097-a586-aa147d6adbcf tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:21.002001 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-68e153ac-e9cf-4097-a586-aa147d6adbcf tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87/ips" status: 200 len: 152 microversion: 2.20 time: 0.215878 Jun 30 10:06:21.002541 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 373/726] 10.222.0.16 () {60 vars in 1288 bytes} [Thu Jun 30 10:06:20 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87/ips => generated 152 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 10:06:21.020723 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-87956da1-c948-4819-857e-6a5481b05598 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:21.028494 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-87956da1-c948-4819-857e-6a5481b05598 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443" status: 200 len: 1367 microversion: 2.1 time: 0.153596 Jun 30 10:06:21.029492 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 354/727] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:20 2022] GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:06:21.233261 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-d1be8491-fac0-4d0d-931d-886a41bf947e tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:21.234223 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-d1be8491-fac0-4d0d-931d-886a41bf947e tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 1802a0eb-4ac0-4939-b119-af84e90c5859] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:21.241143 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d1be8491-fac0-4d0d-931d-886a41bf947e tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:21.241854 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d1be8491-fac0-4d0d-931d-886a41bf947e tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:21.242804 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d1be8491-fac0-4d0d-931d-886a41bf947e tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:21.243235 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d1be8491-fac0-4d0d-931d-886a41bf947e tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:21.247631 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:06:21.395499 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-d1be8491-fac0-4d0d-931d-886a41bf947e tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:21.403103 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-d1be8491-fac0-4d0d-931d-886a41bf947e tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859" status: 200 len: 1264 microversion: 2.1 time: 0.173876 Jun 30 10:06:21.403701 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 374/728] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:21 2022] GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859 => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:22.049158 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-943d0c7b-7cb5-4275-8500-6ea177e30e8a tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:22.049790 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-943d0c7b-7cb5-4275-8500-6ea177e30e8a tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: cc0df4f5-54ea-46ae-837b-66e0a4c09443] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:22.056806 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-943d0c7b-7cb5-4275-8500-6ea177e30e8a tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:22.057249 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-943d0c7b-7cb5-4275-8500-6ea177e30e8a tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:22.057995 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-943d0c7b-7cb5-4275-8500-6ea177e30e8a tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:22.058420 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-943d0c7b-7cb5-4275-8500-6ea177e30e8a tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:22.073478 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:06:22.203689 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-943d0c7b-7cb5-4275-8500-6ea177e30e8a tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:22.211860 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-943d0c7b-7cb5-4275-8500-6ea177e30e8a tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443" status: 200 len: 1367 microversion: 2.1 time: 0.168672 Jun 30 10:06:22.212450 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 355/729] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:22 2022] GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:22.421416 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-776ee028-a041-4b7f-bbda-68bbd1dc1e10 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:22.422017 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-776ee028-a041-4b7f-bbda-68bbd1dc1e10 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 1802a0eb-4ac0-4939-b119-af84e90c5859] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:22.429063 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-776ee028-a041-4b7f-bbda-68bbd1dc1e10 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:22.429504 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-776ee028-a041-4b7f-bbda-68bbd1dc1e10 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:22.430261 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-776ee028-a041-4b7f-bbda-68bbd1dc1e10 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:22.430688 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-776ee028-a041-4b7f-bbda-68bbd1dc1e10 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:22.569330 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-776ee028-a041-4b7f-bbda-68bbd1dc1e10 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:22.580719 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-776ee028-a041-4b7f-bbda-68bbd1dc1e10 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859" status: 200 len: 1264 microversion: 2.1 time: 0.162892 Jun 30 10:06:22.581440 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 375/730] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:22 2022] GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:22.674174 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-523a60ee-523f-4714-a6b9-acf6d50df787 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:22.674809 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-523a60ee-523f-4714-a6b9-acf6d50df787 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:22.681280 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-523a60ee-523f-4714-a6b9-acf6d50df787 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:22.681726 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-523a60ee-523f-4714-a6b9-acf6d50df787 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:22.682483 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-523a60ee-523f-4714-a6b9-acf6d50df787 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:22.682914 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-523a60ee-523f-4714-a6b9-acf6d50df787 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:22.711488 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-523a60ee-523f-4714-a6b9-acf6d50df787 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Going to try to terminate instance {{(pid=117847) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 10:06:22.795357 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-523a60ee-523f-4714-a6b9-acf6d50df787 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "DELETE /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 204 len: 0 microversion: 2.1 time: 0.124580 Jun 30 10:06:22.796241 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 356/731] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 10:06:22 2022] DELETE /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 10:06:22.808481 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-58c67463-4737-4e41-83ca-eb7c3aa7c47f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:22.809181 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-58c67463-4737-4e41-83ca-eb7c3aa7c47f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:22.816545 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-58c67463-4737-4e41-83ca-eb7c3aa7c47f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:22.817064 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-58c67463-4737-4e41-83ca-eb7c3aa7c47f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:22.818071 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-58c67463-4737-4e41-83ca-eb7c3aa7c47f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:22.818751 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-58c67463-4737-4e41-83ca-eb7c3aa7c47f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:22.899356 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [req-1756cabf-a1b0-477b-9a85-2909e1df5a77 req-afb76090-3536-4c7d-9ebd-0d2dfb76b7da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc0df4f5-54ea-46ae-837b-66e0a4c09443", "name": "network-vif-plugged", "status": "completed", "tag": "c290f600-5bbc-467b-a453-efdf017e12bb"}]} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:06:22.908161 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-1756cabf-a1b0-477b-9a85-2909e1df5a77 req-afb76090-3536-4c7d-9ebd-0d2dfb76b7da service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:22.908604 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-1756cabf-a1b0-477b-9a85-2909e1df5a77 req-afb76090-3536-4c7d-9ebd-0d2dfb76b7da service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:22.919941 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.compute.server_external_events [req-1756cabf-a1b0-477b-9a85-2909e1df5a77 req-afb76090-3536-4c7d-9ebd-0d2dfb76b7da service nova] Creating event network-vif-plugged:c290f600-5bbc-467b-a453-efdf017e12bb for instance cc0df4f5-54ea-46ae-837b-66e0a4c09443 on hv-cinder-84330 Jun 30 10:06:22.925563 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [req-1756cabf-a1b0-477b-9a85-2909e1df5a77 req-afb76090-3536-4c7d-9ebd-0d2dfb76b7da service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104774 Jun 30 10:06:22.926195 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 357/732] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:06:22.931324 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-a836adc3-1bf3-4007-b1b2-8f030b93a77f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:06:22.931977 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-a836adc3-1bf3-4007-b1b2-8f030b93a77f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:22.938992 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a836adc3-1bf3-4007-b1b2-8f030b93a77f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:22.939435 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a836adc3-1bf3-4007-b1b2-8f030b93a77f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:22.940232 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a836adc3-1bf3-4007-b1b2-8f030b93a77f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:22.940667 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a836adc3-1bf3-4007-b1b2-8f030b93a77f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:22.959794 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-58c67463-4737-4e41-83ca-eb7c3aa7c47f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:22.963321 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.objects.instance [None req-a836adc3-1bf3-4007-b1b2-8f030b93a77f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lazy-loading 'flavor' on Instance uuid 4ac05989-c74b-4ae8-90c2-b1c16bd45f87 {{(pid=117847) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:06:22.967519 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-58c67463-4737-4e41-83ca-eb7c3aa7c47f tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1509 microversion: 2.1 time: 0.166536 Jun 30 10:06:22.968129 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 376/733] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:22 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:23.228844 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-3c0d55b3-8d00-4964-ae4c-086a00b8df7e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:23.229468 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-3c0d55b3-8d00-4964-ae4c-086a00b8df7e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: cc0df4f5-54ea-46ae-837b-66e0a4c09443] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:23.236171 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3c0d55b3-8d00-4964-ae4c-086a00b8df7e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:23.236603 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-a836adc3-1bf3-4007-b1b2-8f030b93a77f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "POST /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87/action" status: 202 len: 0 microversion: 2.20 time: 0.308984 Jun 30 10:06:23.237053 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3c0d55b3-8d00-4964-ae4c-086a00b8df7e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:23.237492 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3c0d55b3-8d00-4964-ae4c-086a00b8df7e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:23.237610 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 358/734] 10.222.0.16 () {62 vars in 1318 bytes} [Thu Jun 30 10:06:22 2022] POST /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 30 10:06:23.237861 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3c0d55b3-8d00-4964-ae4c-086a00b8df7e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:23.245490 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-a9b07d0c-c706-4fa4-a322-250c7b345b1f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:23.246177 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-a9b07d0c-c706-4fa4-a322-250c7b345b1f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:23.252815 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a9b07d0c-c706-4fa4-a322-250c7b345b1f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:23.253261 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a9b07d0c-c706-4fa4-a322-250c7b345b1f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:23.254025 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a9b07d0c-c706-4fa4-a322-250c7b345b1f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:23.254451 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a9b07d0c-c706-4fa4-a322-250c7b345b1f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:23.440885 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-3c0d55b3-8d00-4964-ae4c-086a00b8df7e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:23.444113 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-a9b07d0c-c706-4fa4-a322-250c7b345b1f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:23.448859 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-3c0d55b3-8d00-4964-ae4c-086a00b8df7e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443" status: 200 len: 1367 microversion: 2.1 time: 0.224073 Jun 30 10:06:23.449430 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 377/735] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:23 2022] GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:06:23.452568 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-a9b07d0c-c706-4fa4-a322-250c7b345b1f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:23.454291 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-a9b07d0c-c706-4fa4-a322-250c7b345b1f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:23.455521 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-a9b07d0c-c706-4fa4-a322-250c7b345b1f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1724 microversion: 2.20 time: 0.214022 Jun 30 10:06:23.456143 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 359/736] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:06:23 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:06:23.602744 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f5fcd3f2-ca6a-4186-b345-9afb74ded050 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:23.603392 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f5fcd3f2-ca6a-4186-b345-9afb74ded050 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 1802a0eb-4ac0-4939-b119-af84e90c5859] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:23.609609 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f5fcd3f2-ca6a-4186-b345-9afb74ded050 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:23.610107 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f5fcd3f2-ca6a-4186-b345-9afb74ded050 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:23.610856 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f5fcd3f2-ca6a-4186-b345-9afb74ded050 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:23.611257 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f5fcd3f2-ca6a-4186-b345-9afb74ded050 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:23.748286 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f5fcd3f2-ca6a-4186-b345-9afb74ded050 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:23.757195 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f5fcd3f2-ca6a-4186-b345-9afb74ded050 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859" status: 200 len: 1264 microversion: 2.1 time: 0.158328 Jun 30 10:06:23.757760 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 378/737] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:23 2022] GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:23.985366 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-e66e3962-8681-4f91-b15b-b86056ffa12a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:23.986042 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-e66e3962-8681-4f91-b15b-b86056ffa12a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:23.992797 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e66e3962-8681-4f91-b15b-b86056ffa12a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:23.993239 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e66e3962-8681-4f91-b15b-b86056ffa12a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:23.993998 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e66e3962-8681-4f91-b15b-b86056ffa12a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:23.994421 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e66e3962-8681-4f91-b15b-b86056ffa12a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:24.179233 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-e66e3962-8681-4f91-b15b-b86056ffa12a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:24.186782 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-e66e3962-8681-4f91-b15b-b86056ffa12a tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1509 microversion: 2.1 time: 0.205487 Jun 30 10:06:24.187790 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 360/738] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:23 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1509 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:24.466075 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-7b45e1c9-5a90-4a09-89d3-3c657c557816 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:24.466637 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-7b45e1c9-5a90-4a09-89d3-3c657c557816 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: cc0df4f5-54ea-46ae-837b-66e0a4c09443] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:24.473897 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7b45e1c9-5a90-4a09-89d3-3c657c557816 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:24.474313 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7b45e1c9-5a90-4a09-89d3-3c657c557816 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:24.475104 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7b45e1c9-5a90-4a09-89d3-3c657c557816 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:24.475366 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-c90ca792-78ad-421e-bcd8-7d403ca712cd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:24.475793 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7b45e1c9-5a90-4a09-89d3-3c657c557816 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:24.475996 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-c90ca792-78ad-421e-bcd8-7d403ca712cd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:24.483074 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c90ca792-78ad-421e-bcd8-7d403ca712cd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:24.483519 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c90ca792-78ad-421e-bcd8-7d403ca712cd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:24.484293 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c90ca792-78ad-421e-bcd8-7d403ca712cd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:24.484810 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c90ca792-78ad-421e-bcd8-7d403ca712cd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:25.017025 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7b45e1c9-5a90-4a09-89d3-3c657c557816 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:25.020943 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-c90ca792-78ad-421e-bcd8-7d403ca712cd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:25.024795 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-7b45e1c9-5a90-4a09-89d3-3c657c557816 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443" status: 200 len: 1367 microversion: 2.1 time: 0.562452 Jun 30 10:06:25.025356 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 379/739] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:24 2022] GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443 => generated 1367 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:25.029977 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-3b506253-e662-4a96-8725-6ba9522b43e0 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:25.030566 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-3b506253-e662-4a96-8725-6ba9522b43e0 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 1802a0eb-4ac0-4939-b119-af84e90c5859] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:25.036861 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3b506253-e662-4a96-8725-6ba9522b43e0 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:25.037311 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3b506253-e662-4a96-8725-6ba9522b43e0 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:25.038072 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3b506253-e662-4a96-8725-6ba9522b43e0 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:25.038502 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3b506253-e662-4a96-8725-6ba9522b43e0 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:25.039170 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-c90ca792-78ad-421e-bcd8-7d403ca712cd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:25.040815 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-c90ca792-78ad-421e-bcd8-7d403ca712cd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:25.042047 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-c90ca792-78ad-421e-bcd8-7d403ca712cd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1724 microversion: 2.20 time: 0.572074 Jun 30 10:06:25.043075 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 361/740] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:06:24 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1724 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:06:25.204494 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-586372a5-83e6-48d6-9f8a-9894a4c2de1e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:25.205078 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-586372a5-83e6-48d6-9f8a-9894a4c2de1e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:25.214064 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-586372a5-83e6-48d6-9f8a-9894a4c2de1e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:25.214845 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-586372a5-83e6-48d6-9f8a-9894a4c2de1e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:25.215632 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-586372a5-83e6-48d6-9f8a-9894a4c2de1e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:25.216247 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-586372a5-83e6-48d6-9f8a-9894a4c2de1e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:25.266504 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-3b506253-e662-4a96-8725-6ba9522b43e0 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:25.279188 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-3b506253-e662-4a96-8725-6ba9522b43e0 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859" status: 200 len: 1264 microversion: 2.1 time: 0.252564 Jun 30 10:06:25.279769 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 380/741] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:25 2022] GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859 => generated 1264 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:25.332526 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-586372a5-83e6-48d6-9f8a-9894a4c2de1e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:25.340328 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-586372a5-83e6-48d6-9f8a-9894a4c2de1e tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 200 len: 1467 microversion: 2.1 time: 0.139911 Jun 30 10:06:25.350876 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 362/742] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:25 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 1467 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:06:25.350993 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-8372a751-c7ab-48f5-9ee0-7958f62b445a req-0e1df00d-1088-4b03-bdd4-6b74cec2b88f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75c53f4a-19c7-4452-8243-40e32ce8c2b3", "name": "network-vif-deleted", "tag": "a18a08f6-983b-4ecd-acd2-550b4a54f767"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:06:25.360883 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-8372a751-c7ab-48f5-9ee0-7958f62b445a req-0e1df00d-1088-4b03-bdd4-6b74cec2b88f service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:25.361728 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-8372a751-c7ab-48f5-9ee0-7958f62b445a req-0e1df00d-1088-4b03-bdd4-6b74cec2b88f service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:25.373563 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-8372a751-c7ab-48f5-9ee0-7958f62b445a req-0e1df00d-1088-4b03-bdd4-6b74cec2b88f service nova] Creating event network-vif-deleted:a18a08f6-983b-4ecd-acd2-550b4a54f767 for instance 75c53f4a-19c7-4452-8243-40e32ce8c2b3 on hv-cinder-84330 Jun 30 10:06:25.379824 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-8372a751-c7ab-48f5-9ee0-7958f62b445a req-0e1df00d-1088-4b03-bdd4-6b74cec2b88f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033367 Jun 30 10:06:25.380567 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 381/743] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:06:26.046490 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-567c1dda-21db-4766-a292-4ad4a7f7670d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:26.047411 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-567c1dda-21db-4766-a292-4ad4a7f7670d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: cc0df4f5-54ea-46ae-837b-66e0a4c09443] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:26.054006 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-567c1dda-21db-4766-a292-4ad4a7f7670d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:26.054457 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-567c1dda-21db-4766-a292-4ad4a7f7670d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:26.055219 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-567c1dda-21db-4766-a292-4ad4a7f7670d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:26.055642 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-567c1dda-21db-4766-a292-4ad4a7f7670d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:26.061452 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f7818af1-1cf8-4cf7-a7b0-c1d3fc9b7443 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:26.062483 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f7818af1-1cf8-4cf7-a7b0-c1d3fc9b7443 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:26.069515 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f7818af1-1cf8-4cf7-a7b0-c1d3fc9b7443 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:26.069913 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f7818af1-1cf8-4cf7-a7b0-c1d3fc9b7443 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:26.070685 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f7818af1-1cf8-4cf7-a7b0-c1d3fc9b7443 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:26.071452 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f7818af1-1cf8-4cf7-a7b0-c1d3fc9b7443 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:26.283954 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-567c1dda-21db-4766-a292-4ad4a7f7670d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:26.290575 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f7818af1-1cf8-4cf7-a7b0-c1d3fc9b7443 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:26.300165 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f7818af1-1cf8-4cf7-a7b0-c1d3fc9b7443 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:26.301751 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f7818af1-1cf8-4cf7-a7b0-c1d3fc9b7443 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:26.301936 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-567c1dda-21db-4766-a292-4ad4a7f7670d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443" status: 200 len: 1367 microversion: 2.1 time: 0.261783 Jun 30 10:06:26.303458 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f7818af1-1cf8-4cf7-a7b0-c1d3fc9b7443 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1724 microversion: 2.20 time: 0.246356 Jun 30 10:06:26.304042 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 363/744] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:26 2022] GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443 => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:26.304609 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 382/745] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:06:26 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:06:26.309310 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-2ee235f0-ec55-4f8f-8007-405be418ca8b tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:26.310026 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-2ee235f0-ec55-4f8f-8007-405be418ca8b tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 1802a0eb-4ac0-4939-b119-af84e90c5859] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:26.316906 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2ee235f0-ec55-4f8f-8007-405be418ca8b tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:26.317431 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2ee235f0-ec55-4f8f-8007-405be418ca8b tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:26.318275 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2ee235f0-ec55-4f8f-8007-405be418ca8b tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:26.318744 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2ee235f0-ec55-4f8f-8007-405be418ca8b tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:26.358658 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-83ccc409-a924-49e5-9bbc-f690535d802d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:26.359260 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-83ccc409-a924-49e5-9bbc-f690535d802d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 75c53f4a-19c7-4452-8243-40e32ce8c2b3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:26.367200 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-83ccc409-a924-49e5-9bbc-f690535d802d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:26.367701 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-83ccc409-a924-49e5-9bbc-f690535d802d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:26.368496 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-83ccc409-a924-49e5-9bbc-f690535d802d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:26.369002 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-83ccc409-a924-49e5-9bbc-f690535d802d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:26.387351 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-83ccc409-a924-49e5-9bbc-f690535d802d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] HTTP exception thrown: Instance 75c53f4a-19c7-4452-8243-40e32ce8c2b3 could not be found. Jun 30 10:06:26.389027 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-83ccc409-a924-49e5-9bbc-f690535d802d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Request method failure captured: Jun 30 10:06:26.389027 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: request: GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 HTTP/1.1 Jun 30 10:06:26.389027 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept: application/json Jun 30 10:06:26.389027 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jun 30 10:06:26.389027 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Connection: close Jun 30 10:06:26.389027 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jun 30 10:06:26.389027 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jun 30 10:06:26.389027 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Host: 10.222.0.16 Jun 30 10:06:26.389027 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jun 30 10:06:26.389027 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jun 30 10:06:26.389027 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABivXQ_-92o37DZs6KJkFkKOmwxkiwRqM5n-bwQzekE2akVqDN2T3UK3mXb5Q8vEgciD0-EZqDYHyMkNaHedrwR7kZ3VKOpjwe1q5N7_yLnQiQ9zWLbjXnQrmxPyI_YaSVtdEv4Ga6FaF9gEp45Vke44RdWPpPt0d1FP07cbOTc_eXjbzk Jun 30 10:06:26.389027 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jun 30 10:06:26.389027 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jun 30 10:06:26.389027 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jun 30 10:06:26.389027 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jun 30 10:06:26.389027 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jun 30 10:06:26.389027 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jun 30 10:06:26.389027 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Id: 0e8bc4e999ce4f1e9f52b456bcdd88d3 Jun 30 10:06:26.389027 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1274875426 Jun 30 10:06:26.389027 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Role: reader,member Jun 30 10:06:26.389027 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Roles: reader,member Jun 30 10:06:26.390354 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e8bc4e999ce4f1e9f52b456bcdd88d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0e8bc4e999ce4f1e9f52b456bcdd88d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e8bc4e999ce4f1e9f52b456bcdd88d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0e8bc4e999ce4f1e9f52b456bcdd88d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:06:26.390354 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1274875426 Jun 30 10:06:26.390354 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 0e8bc4e999ce4f1e9f52b456bcdd88d3 Jun 30 10:06:26.390354 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1274875426 Jun 30 10:06:26.390354 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User: tempest-ServerRescueNegativeTestJSON-1274875426-project Jun 30 10:06:26.390354 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jun 30 10:06:26.390354 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jun 30 10:06:26.390354 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Id: a179e34636ed4970be4f0790115f9d8f Jun 30 10:06:26.390354 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1274875426-project Jun 30 10:06:26.390354 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: method: > Jun 30 10:06:26.390354 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: exception: Instance 75c53f4a-19c7-4452-8243-40e32ce8c2b3 could not be found. Jun 30 10:06:26.390354 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: action_args: {'id': '75c53f4a-19c7-4452-8243-40e32ce8c2b3'} Jun 30 10:06:26.391154 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:06:26.391154 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:06:26.391154 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:06:26.391154 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:06:26.391154 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:06:26.391154 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:06:26.391154 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:06:26.391154 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:06:26.391154 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:06:26.391154 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:06:26.391154 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75c53f4a-19c7-4452-8243-40e32ce8c2b3 could not be found. Jun 30 10:06:26.391154 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:06:26.391154 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:06:26.391154 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:06:26.391154 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:06:26.391154 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:06:26.391154 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:06:26.391154 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:06:26.391154 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:06:26.391154 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:06:26.392547 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:06:26.392547 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:06:26.392547 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:06:26.392547 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:06:26.392547 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:06:26.392547 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:06:26.392547 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:06:26.392547 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75c53f4a-19c7-4452-8243-40e32ce8c2b3 could not be found. Jun 30 10:06:26.392547 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:06:26.392547 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:06:26.392547 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:06:26.392547 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:06:26.392547 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:06:26.392547 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:06:26.392547 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:06:26.392547 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:06:26.392547 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75c53f4a-19c7-4452-8243-40e32ce8c2b3 could not be found. Jun 30 10:06:26.392547 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:06:26.393693 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-83ccc409-a924-49e5-9bbc-f690535d802d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Returning 404 to user: Instance 75c53f4a-19c7-4452-8243-40e32ce8c2b3 could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:06:26.393693 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-83ccc409-a924-49e5-9bbc-f690535d802d tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3" status: 404 len: 111 microversion: 2.1 time: 0.036036 Jun 30 10:06:26.393693 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 383/746] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:26 2022] GET /compute/v2.1/servers/75c53f4a-19c7-4452-8243-40e32ce8c2b3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:06:26.399899 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-c43fc35e-fa6a-4667-bb89-88ea15df23b8 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:26.400381 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-c43fc35e-fa6a-4667-bb89-88ea15df23b8 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:26.407357 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c43fc35e-fa6a-4667-bb89-88ea15df23b8 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:26.407802 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c43fc35e-fa6a-4667-bb89-88ea15df23b8 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:26.408596 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c43fc35e-fa6a-4667-bb89-88ea15df23b8 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:26.409018 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c43fc35e-fa6a-4667-bb89-88ea15df23b8 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:26.434150 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-c43fc35e-fa6a-4667-bb89-88ea15df23b8 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Going to try to terminate instance {{(pid=117846) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 10:06:26.467343 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-2ee235f0-ec55-4f8f-8007-405be418ca8b tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:26.475475 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-2ee235f0-ec55-4f8f-8007-405be418ca8b tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859" status: 200 len: 1264 microversion: 2.1 time: 0.169677 Jun 30 10:06:26.476057 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 364/747] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:26 2022] GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:26.512731 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-c43fc35e-fa6a-4667-bb89-88ea15df23b8 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 204 len: 0 microversion: 2.1 time: 0.116858 Jun 30 10:06:26.513747 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 384/748] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 10:06:26 2022] DELETE /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 30 10:06:26.521692 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-02f9b0b2-e920-4282-8b12-a8ec7a5a6be3 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:26.522298 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-02f9b0b2-e920-4282-8b12-a8ec7a5a6be3 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:26.528420 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-02f9b0b2-e920-4282-8b12-a8ec7a5a6be3 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:26.528866 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-02f9b0b2-e920-4282-8b12-a8ec7a5a6be3 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:26.529654 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-02f9b0b2-e920-4282-8b12-a8ec7a5a6be3 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:26.530088 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-02f9b0b2-e920-4282-8b12-a8ec7a5a6be3 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:26.662624 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-02f9b0b2-e920-4282-8b12-a8ec7a5a6be3 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:26.670659 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-02f9b0b2-e920-4282-8b12-a8ec7a5a6be3 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 200 len: 1522 microversion: 2.1 time: 0.152709 Jun 30 10:06:26.671228 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 365/749] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:26 2022] GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:27.320047 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-5b888ed5-94b2-4fb8-8b7e-1d311d694b8f tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:27.320739 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-5b888ed5-94b2-4fb8-8b7e-1d311d694b8f tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: cc0df4f5-54ea-46ae-837b-66e0a4c09443] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:27.323106 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-7365319d-86fe-41ab-b269-1ae64863be4a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:27.323709 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-7365319d-86fe-41ab-b269-1ae64863be4a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:27.327729 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5b888ed5-94b2-4fb8-8b7e-1d311d694b8f tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:27.328349 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5b888ed5-94b2-4fb8-8b7e-1d311d694b8f tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:27.329182 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5b888ed5-94b2-4fb8-8b7e-1d311d694b8f tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:27.329874 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5b888ed5-94b2-4fb8-8b7e-1d311d694b8f tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:27.330458 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7365319d-86fe-41ab-b269-1ae64863be4a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:27.330956 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7365319d-86fe-41ab-b269-1ae64863be4a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:27.331911 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7365319d-86fe-41ab-b269-1ae64863be4a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:27.332492 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7365319d-86fe-41ab-b269-1ae64863be4a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:27.534523 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-5b888ed5-94b2-4fb8-8b7e-1d311d694b8f tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:27.540967 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-7365319d-86fe-41ab-b269-1ae64863be4a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:27.542410 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-5b888ed5-94b2-4fb8-8b7e-1d311d694b8f tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443" status: 200 len: 1558 microversion: 2.1 time: 0.227084 Jun 30 10:06:27.543287 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 385/750] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:27 2022] GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443 => generated 1558 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:27.547855 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-58df0d2b-9c78-40ca-bf65-f65758f680ec tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:27.548406 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-58df0d2b-9c78-40ca-bf65-f65758f680ec tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 1802a0eb-4ac0-4939-b119-af84e90c5859] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:27.550229 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-7365319d-86fe-41ab-b269-1ae64863be4a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:27.551739 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-7365319d-86fe-41ab-b269-1ae64863be4a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:27.552935 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-7365319d-86fe-41ab-b269-1ae64863be4a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1724 microversion: 2.20 time: 0.234502 Jun 30 10:06:27.553605 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 366/751] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:06:27 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:06:27.555070 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-58df0d2b-9c78-40ca-bf65-f65758f680ec tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:27.555542 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-58df0d2b-9c78-40ca-bf65-f65758f680ec tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:27.556330 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-58df0d2b-9c78-40ca-bf65-f65758f680ec tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:27.556776 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-58df0d2b-9c78-40ca-bf65-f65758f680ec tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:27.559279 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-1ebf89c1-b591-470e-a27c-c4cee2cb9106 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:27.559772 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-1ebf89c1-b591-470e-a27c-c4cee2cb9106 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: cc0df4f5-54ea-46ae-837b-66e0a4c09443] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:27.566435 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1ebf89c1-b591-470e-a27c-c4cee2cb9106 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:27.566881 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1ebf89c1-b591-470e-a27c-c4cee2cb9106 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:27.567635 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1ebf89c1-b591-470e-a27c-c4cee2cb9106 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:27.568099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1ebf89c1-b591-470e-a27c-c4cee2cb9106 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:27.673380 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-1ebf89c1-b591-470e-a27c-c4cee2cb9106 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.117736 Jun 30 10:06:27.673974 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 367/752] 10.222.0.16 () {58 vars in 1274 bytes} [Thu Jun 30 10:06:27 2022] GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443/os-interface => generated 285 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:06:27.688496 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-95663ba3-b11f-4043-94a4-adcfcfee9b3b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:27.689234 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-95663ba3-b11f-4043-94a4-adcfcfee9b3b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:27.695643 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-95663ba3-b11f-4043-94a4-adcfcfee9b3b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:27.696156 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-95663ba3-b11f-4043-94a4-adcfcfee9b3b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:27.696921 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-95663ba3-b11f-4043-94a4-adcfcfee9b3b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:27.697352 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-95663ba3-b11f-4043-94a4-adcfcfee9b3b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:27.726065 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-58df0d2b-9c78-40ca-bf65-f65758f680ec tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:27.734179 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-58df0d2b-9c78-40ca-bf65-f65758f680ec tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859" status: 200 len: 1264 microversion: 2.1 time: 0.190139 Jun 30 10:06:27.735102 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 386/753] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:27 2022] GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859 => generated 1264 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:27.826609 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-95663ba3-b11f-4043-94a4-adcfcfee9b3b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:27.834274 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-95663ba3-b11f-4043-94a4-adcfcfee9b3b tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 200 len: 1522 microversion: 2.1 time: 0.150204 Jun 30 10:06:27.834873 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 368/754] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:27 2022] GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:06:28.572417 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-fc49bd7a-246f-447a-b519-6e46eb41bb60 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:28.573022 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-fc49bd7a-246f-447a-b519-6e46eb41bb60 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:28.580710 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fc49bd7a-246f-447a-b519-6e46eb41bb60 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:28.581163 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fc49bd7a-246f-447a-b519-6e46eb41bb60 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:28.581930 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fc49bd7a-246f-447a-b519-6e46eb41bb60 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:28.582360 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fc49bd7a-246f-447a-b519-6e46eb41bb60 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:28.671594 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [req-280b8bcd-7d94-4beb-80ad-b776296df0b8 req-280b9b46-785c-4d65-8d7e-b07e4c0bb5c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc0df4f5-54ea-46ae-837b-66e0a4c09443", "tag": "c290f600-5bbc-467b-a453-efdf017e12bb"}]} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:06:28.688484 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-280b8bcd-7d94-4beb-80ad-b776296df0b8 req-280b9b46-785c-4d65-8d7e-b07e4c0bb5c8 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:28.689520 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-280b8bcd-7d94-4beb-80ad-b776296df0b8 req-280b9b46-785c-4d65-8d7e-b07e4c0bb5c8 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:28.703373 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.compute.server_external_events [req-280b8bcd-7d94-4beb-80ad-b776296df0b8 req-280b9b46-785c-4d65-8d7e-b07e4c0bb5c8 service nova] Creating event network-changed:c290f600-5bbc-467b-a453-efdf017e12bb for instance cc0df4f5-54ea-46ae-837b-66e0a4c09443 on hv-cinder-84330 Jun 30 10:06:28.715690 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [req-280b8bcd-7d94-4beb-80ad-b776296df0b8 req-280b9b46-785c-4d65-8d7e-b07e4c0bb5c8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105394 Jun 30 10:06:28.717608 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 369/755] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:06:28.760261 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-1658fe08-1a3f-4aa6-8f5c-bb46e4d0e50f tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:28.762203 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-1658fe08-1a3f-4aa6-8f5c-bb46e4d0e50f tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 1802a0eb-4ac0-4939-b119-af84e90c5859] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:28.770048 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1658fe08-1a3f-4aa6-8f5c-bb46e4d0e50f tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:28.771607 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1658fe08-1a3f-4aa6-8f5c-bb46e4d0e50f tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:28.772936 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1658fe08-1a3f-4aa6-8f5c-bb46e4d0e50f tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:28.773573 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1658fe08-1a3f-4aa6-8f5c-bb46e4d0e50f tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:28.777338 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:06:28.973115 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-fc49bd7a-246f-447a-b519-6e46eb41bb60 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:28.983624 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-fc49bd7a-246f-447a-b519-6e46eb41bb60 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:28.985369 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-fc49bd7a-246f-447a-b519-6e46eb41bb60 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:28.986630 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-fc49bd7a-246f-447a-b519-6e46eb41bb60 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1724 microversion: 2.20 time: 0.419030 Jun 30 10:06:28.987277 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 387/756] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:06:28 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1724 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:06:28.991788 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ca645a2e-4453-422d-951d-7d67929886b5 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:28.992646 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-ca645a2e-4453-422d-951d-7d67929886b5 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:28.998879 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ca645a2e-4453-422d-951d-7d67929886b5 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:29.000762 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ca645a2e-4453-422d-951d-7d67929886b5 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:29.001864 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ca645a2e-4453-422d-951d-7d67929886b5 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:29.002363 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ca645a2e-4453-422d-951d-7d67929886b5 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:29.226759 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-1658fe08-1a3f-4aa6-8f5c-bb46e4d0e50f tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:29.236326 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-1658fe08-1a3f-4aa6-8f5c-bb46e4d0e50f tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859" status: 200 len: 1264 microversion: 2.1 time: 0.487805 Jun 30 10:06:29.245848 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 370/757] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:28 2022] GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859 => generated 1264 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:29.245848 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [req-c8d7fd8f-5136-4238-b59a-f28e8e39b47d req-0485e400-5002-4eb8-8faf-5f387ab1e9f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1802a0eb-4ac0-4939-b119-af84e90c5859", "name": "network-vif-plugged", "status": "completed", "tag": "25a1c145-b1e0-489f-b51e-b65ee144d124"}]} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:06:29.249615 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-c8d7fd8f-5136-4238-b59a-f28e8e39b47d req-0485e400-5002-4eb8-8faf-5f387ab1e9f1 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:29.250305 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-c8d7fd8f-5136-4238-b59a-f28e8e39b47d req-0485e400-5002-4eb8-8faf-5f387ab1e9f1 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:29.261807 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.compute.server_external_events [req-c8d7fd8f-5136-4238-b59a-f28e8e39b47d req-0485e400-5002-4eb8-8faf-5f387ab1e9f1 service nova] Creating event network-vif-plugged:25a1c145-b1e0-489f-b51e-b65ee144d124 for instance 1802a0eb-4ac0-4939-b119-af84e90c5859 on hv-cinder-84330 Jun 30 10:06:29.267305 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [req-c8d7fd8f-5136-4238-b59a-f28e8e39b47d req-0485e400-5002-4eb8-8faf-5f387ab1e9f1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029124 Jun 30 10:06:29.268396 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 371/758] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:06:29.353057 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ca645a2e-4453-422d-951d-7d67929886b5 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:29.360582 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ca645a2e-4453-422d-951d-7d67929886b5 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 200 len: 1522 microversion: 2.1 time: 0.371968 Jun 30 10:06:29.371088 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 388/759] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:28 2022] GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 1522 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:29.683458 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [req-256d4eae-9c28-44e9-a59c-93c7db7b60a5 req-f2c0b487-abb8-4b91-b3bb-984ad6160cbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aa5453f-b4af-4817-a8d4-173f27d1cbd3", "name": "network-vif-deleted", "tag": "940a702f-df85-4d3f-ab5f-e3a86923fecb"}]} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:06:29.696249 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-256d4eae-9c28-44e9-a59c-93c7db7b60a5 req-f2c0b487-abb8-4b91-b3bb-984ad6160cbe service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:29.697699 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-256d4eae-9c28-44e9-a59c-93c7db7b60a5 req-f2c0b487-abb8-4b91-b3bb-984ad6160cbe service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:29.712448 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.compute.server_external_events [req-256d4eae-9c28-44e9-a59c-93c7db7b60a5 req-f2c0b487-abb8-4b91-b3bb-984ad6160cbe service nova] Creating event network-vif-deleted:940a702f-df85-4d3f-ab5f-e3a86923fecb for instance 3aa5453f-b4af-4817-a8d4-173f27d1cbd3 on hv-cinder-84330 Jun 30 10:06:29.722217 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [req-256d4eae-9c28-44e9-a59c-93c7db7b60a5 req-f2c0b487-abb8-4b91-b3bb-984ad6160cbe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042270 Jun 30 10:06:29.723169 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 372/760] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:06:30.006137 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-64ec377c-66cf-4096-ab7d-3018e2bc890f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:30.006834 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-64ec377c-66cf-4096-ab7d-3018e2bc890f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:30.015673 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-64ec377c-66cf-4096-ab7d-3018e2bc890f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:30.015673 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-64ec377c-66cf-4096-ab7d-3018e2bc890f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:30.016911 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-64ec377c-66cf-4096-ab7d-3018e2bc890f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:30.017333 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-64ec377c-66cf-4096-ab7d-3018e2bc890f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:30.150449 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-64ec377c-66cf-4096-ab7d-3018e2bc890f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:30.159444 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-64ec377c-66cf-4096-ab7d-3018e2bc890f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:30.161133 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-64ec377c-66cf-4096-ab7d-3018e2bc890f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:30.162513 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-64ec377c-66cf-4096-ab7d-3018e2bc890f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1724 microversion: 2.20 time: 0.160609 Jun 30 10:06:30.163104 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 389/761] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:06:30 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:06:30.255003 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-3eb8ab91-bf2b-4e32-8d1e-468724391da1 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:30.255643 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-3eb8ab91-bf2b-4e32-8d1e-468724391da1 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 1802a0eb-4ac0-4939-b119-af84e90c5859] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:30.262663 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3eb8ab91-bf2b-4e32-8d1e-468724391da1 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:30.263101 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3eb8ab91-bf2b-4e32-8d1e-468724391da1 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:30.263852 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3eb8ab91-bf2b-4e32-8d1e-468724391da1 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:30.264310 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3eb8ab91-bf2b-4e32-8d1e-468724391da1 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:30.378692 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-8eb36e15-84e2-40a5-bcf8-b2c45f300474 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:30.379323 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-8eb36e15-84e2-40a5-bcf8-b2c45f300474 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:30.385585 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8eb36e15-84e2-40a5-bcf8-b2c45f300474 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:30.386032 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8eb36e15-84e2-40a5-bcf8-b2c45f300474 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:30.386797 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8eb36e15-84e2-40a5-bcf8-b2c45f300474 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:30.387252 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8eb36e15-84e2-40a5-bcf8-b2c45f300474 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:30.402554 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:06:30.404817 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-3eb8ab91-bf2b-4e32-8d1e-468724391da1 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:30.412680 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-3eb8ab91-bf2b-4e32-8d1e-468724391da1 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859" status: 200 len: 1264 microversion: 2.1 time: 0.161994 Jun 30 10:06:30.413333 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 373/762] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:30 2022] GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:30.422044 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8eb36e15-84e2-40a5-bcf8-b2c45f300474 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:30.422564 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8eb36e15-84e2-40a5-bcf8-b2c45f300474 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:30.422996 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.objects.instance [None req-8eb36e15-84e2-40a5-bcf8-b2c45f300474 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lazy-loading 'fault' on Instance uuid 3aa5453f-b4af-4817-a8d4-173f27d1cbd3 {{(pid=117846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:06:30.467472 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-8eb36e15-84e2-40a5-bcf8-b2c45f300474 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a179e34636ed4970be4f0790115f9d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8bc4e999ce4f1e9f52b456bcdd88d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:30.475700 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-8eb36e15-84e2-40a5-bcf8-b2c45f300474 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 200 len: 1312 microversion: 2.1 time: 0.100796 Jun 30 10:06:30.476609 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 390/763] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:30 2022] GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:31.181521 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-58b21a92-7744-47b3-a4af-4a389dc0eb7e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:31.182220 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-58b21a92-7744-47b3-a4af-4a389dc0eb7e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:31.189380 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-58b21a92-7744-47b3-a4af-4a389dc0eb7e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:31.189830 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-58b21a92-7744-47b3-a4af-4a389dc0eb7e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:31.190588 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-58b21a92-7744-47b3-a4af-4a389dc0eb7e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:31.190994 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-58b21a92-7744-47b3-a4af-4a389dc0eb7e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:31.325624 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-58b21a92-7744-47b3-a4af-4a389dc0eb7e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:31.334061 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-58b21a92-7744-47b3-a4af-4a389dc0eb7e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:31.335550 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-58b21a92-7744-47b3-a4af-4a389dc0eb7e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:31.336747 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-58b21a92-7744-47b3-a4af-4a389dc0eb7e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1724 microversion: 2.20 time: 0.159422 Jun 30 10:06:31.337306 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 374/764] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:06:31 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:06:31.435229 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-389f5505-8fde-4ff7-a82b-aaa0b18e8469 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:31.436107 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-389f5505-8fde-4ff7-a82b-aaa0b18e8469 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 1802a0eb-4ac0-4939-b119-af84e90c5859] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:31.444077 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-389f5505-8fde-4ff7-a82b-aaa0b18e8469 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:31.444520 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-389f5505-8fde-4ff7-a82b-aaa0b18e8469 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:31.445281 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-389f5505-8fde-4ff7-a82b-aaa0b18e8469 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:31.445728 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-389f5505-8fde-4ff7-a82b-aaa0b18e8469 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:31.495472 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-fe87b64f-9dd1-4615-9103-eaedb95acd17 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:31.496127 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-fe87b64f-9dd1-4615-9103-eaedb95acd17 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] [instance: 3aa5453f-b4af-4817-a8d4-173f27d1cbd3] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:31.502692 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-fe87b64f-9dd1-4615-9103-eaedb95acd17 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:31.503128 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-fe87b64f-9dd1-4615-9103-eaedb95acd17 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:31.503904 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-fe87b64f-9dd1-4615-9103-eaedb95acd17 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:31.504364 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-fe87b64f-9dd1-4615-9103-eaedb95acd17 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:31.518109 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.wsgi [None req-fe87b64f-9dd1-4615-9103-eaedb95acd17 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] HTTP exception thrown: Instance 3aa5453f-b4af-4817-a8d4-173f27d1cbd3 could not be found. Jun 30 10:06:31.519748 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-fe87b64f-9dd1-4615-9103-eaedb95acd17 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Request method failure captured: Jun 30 10:06:31.519748 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: request: GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 HTTP/1.1 Jun 30 10:06:31.519748 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept: application/json Jun 30 10:06:31.519748 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept-Encoding: identity Jun 30 10:06:31.519748 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Connection: close Jun 30 10:06:31.519748 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Length: 0 Jun 30 10:06:31.519748 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Type: application/json Jun 30 10:06:31.519748 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Host: 10.222.0.16 Jun 30 10:06:31.519748 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Openstack-System-Scope: None Jun 30 10:06:31.519748 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: User-Agent: python-urllib3/1.26.9 Jun 30 10:06:31.519748 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Auth-Token: gAAAAABivXQ_-92o37DZs6KJkFkKOmwxkiwRqM5n-bwQzekE2akVqDN2T3UK3mXb5Q8vEgciD0-EZqDYHyMkNaHedrwR7kZ3VKOpjwe1q5N7_yLnQiQ9zWLbjXnQrmxPyI_YaSVtdEv4Ga6FaF9gEp45Vke44RdWPpPt0d1FP07cbOTc_eXjbzk Jun 30 10:06:31.519748 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Id: None Jun 30 10:06:31.519748 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Name: None Jun 30 10:06:31.519748 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Identity-Status: Confirmed Jun 30 10:06:31.519748 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Is-Admin-Project: True Jun 30 10:06:31.519748 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Id: default Jun 30 10:06:31.519748 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Name: Default Jun 30 10:06:31.519748 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Id: 0e8bc4e999ce4f1e9f52b456bcdd88d3 Jun 30 10:06:31.519748 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1274875426 Jun 30 10:06:31.519748 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Role: reader,member Jun 30 10:06:31.519748 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Roles: reader,member Jun 30 10:06:31.521233 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e8bc4e999ce4f1e9f52b456bcdd88d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0e8bc4e999ce4f1e9f52b456bcdd88d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e8bc4e999ce4f1e9f52b456bcdd88d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0e8bc4e999ce4f1e9f52b456bcdd88d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:06:31.521233 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1274875426 Jun 30 10:06:31.521233 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Id: 0e8bc4e999ce4f1e9f52b456bcdd88d3 Jun 30 10:06:31.521233 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1274875426 Jun 30 10:06:31.521233 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User: tempest-ServerRescueNegativeTestJSON-1274875426-project Jun 30 10:06:31.521233 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Id: default Jun 30 10:06:31.521233 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Name: Default Jun 30 10:06:31.521233 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Id: a179e34636ed4970be4f0790115f9d8f Jun 30 10:06:31.521233 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1274875426-project Jun 30 10:06:31.521233 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: method: > Jun 30 10:06:31.521233 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: exception: Instance 3aa5453f-b4af-4817-a8d4-173f27d1cbd3 could not be found. Jun 30 10:06:31.521233 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: action_args: {'id': '3aa5453f-b4af-4817-a8d4-173f27d1cbd3'} Jun 30 10:06:31.522081 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:06:31.522081 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:06:31.522081 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:06:31.522081 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:06:31.522081 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:06:31.522081 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:06:31.522081 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:06:31.522081 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:06:31.522081 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:06:31.522081 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:06:31.522081 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aa5453f-b4af-4817-a8d4-173f27d1cbd3 could not be found. Jun 30 10:06:31.522081 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:06:31.522081 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:06:31.522081 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:06:31.522081 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:06:31.522081 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:06:31.522081 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:06:31.522081 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:06:31.522081 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:06:31.522081 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:06:31.523285 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:06:31.523285 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:06:31.523285 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:06:31.523285 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:06:31.523285 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:06:31.523285 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:06:31.523285 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:06:31.523285 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aa5453f-b4af-4817-a8d4-173f27d1cbd3 could not be found. Jun 30 10:06:31.523285 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:06:31.523285 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:06:31.523285 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:06:31.523285 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:06:31.523285 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:06:31.523285 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:06:31.523285 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:06:31.523285 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:06:31.523285 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aa5453f-b4af-4817-a8d4-173f27d1cbd3 could not be found. Jun 30 10:06:31.523285 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:06:31.524396 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-fe87b64f-9dd1-4615-9103-eaedb95acd17 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] Returning 404 to user: Instance 3aa5453f-b4af-4817-a8d4-173f27d1cbd3 could not be found. {{(pid=117847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:06:31.524396 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-fe87b64f-9dd1-4615-9103-eaedb95acd17 tempest-ServerRescueNegativeTestJSON-1274875426 tempest-ServerRescueNegativeTestJSON-1274875426-project] 10.222.0.16 "GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3" status: 404 len: 111 microversion: 2.1 time: 0.029598 Jun 30 10:06:31.524396 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 375/765] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:31 2022] GET /compute/v2.1/servers/3aa5453f-b4af-4817-a8d4-173f27d1cbd3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:06:31.583818 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-389f5505-8fde-4ff7-a82b-aaa0b18e8469 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:31.599467 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-389f5505-8fde-4ff7-a82b-aaa0b18e8469 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859" status: 200 len: 1451 microversion: 2.1 time: 0.170671 Jun 30 10:06:31.610643 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 391/766] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:31 2022] GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859 => generated 1451 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:31.617740 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-866b074f-14b1-4fed-8fac-2c13f996bc91 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:31.618288 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-866b074f-14b1-4fed-8fac-2c13f996bc91 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 1802a0eb-4ac0-4939-b119-af84e90c5859] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:31.624350 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-866b074f-14b1-4fed-8fac-2c13f996bc91 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:31.624805 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-866b074f-14b1-4fed-8fac-2c13f996bc91 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:31.625624 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-866b074f-14b1-4fed-8fac-2c13f996bc91 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:31.626032 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-866b074f-14b1-4fed-8fac-2c13f996bc91 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:31.761334 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-866b074f-14b1-4fed-8fac-2c13f996bc91 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:31.769542 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-866b074f-14b1-4fed-8fac-2c13f996bc91 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859" status: 200 len: 1451 microversion: 2.1 time: 0.157451 Jun 30 10:06:31.770348 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 376/767] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:31 2022] GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859 => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:32.357296 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-2866090c-4148-4ce5-9f36-8171feb39f96 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:32.358142 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-2866090c-4148-4ce5-9f36-8171feb39f96 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:32.370347 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2866090c-4148-4ce5-9f36-8171feb39f96 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:32.371388 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2866090c-4148-4ce5-9f36-8171feb39f96 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:32.372380 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2866090c-4148-4ce5-9f36-8171feb39f96 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:32.373062 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2866090c-4148-4ce5-9f36-8171feb39f96 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:32.902419 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-2866090c-4148-4ce5-9f36-8171feb39f96 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:32.912384 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-2866090c-4148-4ce5-9f36-8171feb39f96 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:32.914061 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-2866090c-4148-4ce5-9f36-8171feb39f96 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:32.915519 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-2866090c-4148-4ce5-9f36-8171feb39f96 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1724 microversion: 2.20 time: 0.564541 Jun 30 10:06:32.916206 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 392/768] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:06:32 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1724 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:06:33.889421 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [req-49be0a68-efa7-42aa-97a4-4d1149d031c8 req-d8aa1bf8-2343-4d4d-af6d-3dc785095045 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1802a0eb-4ac0-4939-b119-af84e90c5859", "tag": "25a1c145-b1e0-489f-b51e-b65ee144d124"}]} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:06:33.898516 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-49be0a68-efa7-42aa-97a4-4d1149d031c8 req-d8aa1bf8-2343-4d4d-af6d-3dc785095045 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:33.898948 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-49be0a68-efa7-42aa-97a4-4d1149d031c8 req-d8aa1bf8-2343-4d4d-af6d-3dc785095045 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:33.910591 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.compute.server_external_events [req-49be0a68-efa7-42aa-97a4-4d1149d031c8 req-d8aa1bf8-2343-4d4d-af6d-3dc785095045 service nova] Creating event network-changed:25a1c145-b1e0-489f-b51e-b65ee144d124 for instance 1802a0eb-4ac0-4939-b119-af84e90c5859 on hv-cinder-84330 Jun 30 10:06:33.915409 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [req-49be0a68-efa7-42aa-97a4-4d1149d031c8 req-d8aa1bf8-2343-4d4d-af6d-3dc785095045 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029776 Jun 30 10:06:33.919218 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 377/769] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:06:33.934228 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-a152f428-8241-4b14-8619-b7be1c1cba97 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:33.934963 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-a152f428-8241-4b14-8619-b7be1c1cba97 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:33.942078 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a152f428-8241-4b14-8619-b7be1c1cba97 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:33.942786 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a152f428-8241-4b14-8619-b7be1c1cba97 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:33.943555 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a152f428-8241-4b14-8619-b7be1c1cba97 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:33.944009 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a152f428-8241-4b14-8619-b7be1c1cba97 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:34.104435 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-a152f428-8241-4b14-8619-b7be1c1cba97 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:34.118070 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-a152f428-8241-4b14-8619-b7be1c1cba97 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:34.120013 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-a152f428-8241-4b14-8619-b7be1c1cba97 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:34.122344 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-a152f428-8241-4b14-8619-b7be1c1cba97 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1724 microversion: 2.20 time: 0.191840 Jun 30 10:06:34.123944 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 393/770] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:06:33 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:06:35.142705 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-d643c6a1-6b49-49bb-b69b-293ad2288344 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:35.143387 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-d643c6a1-6b49-49bb-b69b-293ad2288344 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:35.149770 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d643c6a1-6b49-49bb-b69b-293ad2288344 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:35.150204 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d643c6a1-6b49-49bb-b69b-293ad2288344 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:35.151588 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d643c6a1-6b49-49bb-b69b-293ad2288344 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:35.152043 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d643c6a1-6b49-49bb-b69b-293ad2288344 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:35.313012 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-d643c6a1-6b49-49bb-b69b-293ad2288344 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:35.322169 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-d643c6a1-6b49-49bb-b69b-293ad2288344 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:35.324049 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-d643c6a1-6b49-49bb-b69b-293ad2288344 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:35.325498 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-d643c6a1-6b49-49bb-b69b-293ad2288344 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1745 microversion: 2.20 time: 0.187900 Jun 30 10:06:35.328670 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 378/771] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:06:35 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1745 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:06:36.346817 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-5cf38e0d-2692-4126-bc37-b6cbf99aec6e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:36.348366 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-5cf38e0d-2692-4126-bc37-b6cbf99aec6e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:36.356124 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5cf38e0d-2692-4126-bc37-b6cbf99aec6e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:36.356850 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5cf38e0d-2692-4126-bc37-b6cbf99aec6e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:36.357790 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5cf38e0d-2692-4126-bc37-b6cbf99aec6e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:36.358371 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5cf38e0d-2692-4126-bc37-b6cbf99aec6e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:36.533139 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-5cf38e0d-2692-4126-bc37-b6cbf99aec6e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:36.556118 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-5cf38e0d-2692-4126-bc37-b6cbf99aec6e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:36.558095 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-5cf38e0d-2692-4126-bc37-b6cbf99aec6e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:36.559460 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-5cf38e0d-2692-4126-bc37-b6cbf99aec6e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1740 microversion: 2.20 time: 0.216750 Jun 30 10:06:36.560524 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 394/772] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:06:36 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1740 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:06:37.579020 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-4baaaac3-d80c-4300-a885-0a689c718980 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:37.580299 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-4baaaac3-d80c-4300-a885-0a689c718980 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:37.589621 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4baaaac3-d80c-4300-a885-0a689c718980 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:37.590923 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4baaaac3-d80c-4300-a885-0a689c718980 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:37.593369 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4baaaac3-d80c-4300-a885-0a689c718980 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:37.594675 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4baaaac3-d80c-4300-a885-0a689c718980 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:37.916899 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-4baaaac3-d80c-4300-a885-0a689c718980 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:37.930642 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-4baaaac3-d80c-4300-a885-0a689c718980 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:37.933169 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-4baaaac3-d80c-4300-a885-0a689c718980 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:37.934828 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-4baaaac3-d80c-4300-a885-0a689c718980 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1740 microversion: 2.20 time: 0.359909 Jun 30 10:06:37.951148 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 379/773] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:06:37 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1740 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:06:38.957289 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-6a41d521-8db8-4829-8271-f550007afe6b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:38.958553 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-6a41d521-8db8-4829-8271-f550007afe6b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:38.977992 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6a41d521-8db8-4829-8271-f550007afe6b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:38.978470 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6a41d521-8db8-4829-8271-f550007afe6b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:38.979300 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6a41d521-8db8-4829-8271-f550007afe6b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:38.981543 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6a41d521-8db8-4829-8271-f550007afe6b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:39.005186 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [req-05e4f313-22d5-4cc2-826e-1079414a6e43 req-df7516c5-7a82-4a03-b85f-11b404b2dc2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ac05989-c74b-4ae8-90c2-b1c16bd45f87", "name": "network-vif-plugged", "status": "completed", "tag": "b21d9a4d-e7dc-4e74-9943-8abf6db35a29"}]} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:06:39.024195 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-05e4f313-22d5-4cc2-826e-1079414a6e43 req-df7516c5-7a82-4a03-b85f-11b404b2dc2d service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:39.024701 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-05e4f313-22d5-4cc2-826e-1079414a6e43 req-df7516c5-7a82-4a03-b85f-11b404b2dc2d service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:39.051513 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.compute.server_external_events [req-05e4f313-22d5-4cc2-826e-1079414a6e43 req-df7516c5-7a82-4a03-b85f-11b404b2dc2d service nova] Creating event network-vif-plugged:b21d9a4d-e7dc-4e74-9943-8abf6db35a29 for instance 4ac05989-c74b-4ae8-90c2-b1c16bd45f87 on hv-cinder-84330 Jun 30 10:06:39.066951 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [req-05e4f313-22d5-4cc2-826e-1079414a6e43 req-df7516c5-7a82-4a03-b85f-11b404b2dc2d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063740 Jun 30 10:06:39.072214 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 380/774] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:06:39.407310 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-6a41d521-8db8-4829-8271-f550007afe6b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:39.418219 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-6a41d521-8db8-4829-8271-f550007afe6b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:39.420051 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-6a41d521-8db8-4829-8271-f550007afe6b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:39.421656 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-6a41d521-8db8-4829-8271-f550007afe6b tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1740 microversion: 2.20 time: 0.468657 Jun 30 10:06:39.422475 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 395/775] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:06:38 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1740 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:06:40.456271 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-04f9ac21-c0b6-48ff-b63e-e19793cdb9ca tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:40.456973 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-04f9ac21-c0b6-48ff-b63e-e19793cdb9ca tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:40.525898 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-04f9ac21-c0b6-48ff-b63e-e19793cdb9ca tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:40.526571 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-04f9ac21-c0b6-48ff-b63e-e19793cdb9ca tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:40.537753 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-04f9ac21-c0b6-48ff-b63e-e19793cdb9ca tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:40.539648 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-04f9ac21-c0b6-48ff-b63e-e19793cdb9ca tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:40.842320 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-04f9ac21-c0b6-48ff-b63e-e19793cdb9ca tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:40.855606 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-04f9ac21-c0b6-48ff-b63e-e19793cdb9ca tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:40.869774 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-04f9ac21-c0b6-48ff-b63e-e19793cdb9ca tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:40.871005 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-04f9ac21-c0b6-48ff-b63e-e19793cdb9ca tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1740 microversion: 2.20 time: 0.434356 Jun 30 10:06:40.882694 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 381/776] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:06:40 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1740 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:06:41.894423 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-7a79aa82-3c67-425d-adf6-88dd0a26e397 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:41.909999 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-7a79aa82-3c67-425d-adf6-88dd0a26e397 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:41.918668 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7a79aa82-3c67-425d-adf6-88dd0a26e397 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:41.919405 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7a79aa82-3c67-425d-adf6-88dd0a26e397 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:41.924096 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7a79aa82-3c67-425d-adf6-88dd0a26e397 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:41.928964 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7a79aa82-3c67-425d-adf6-88dd0a26e397 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:42.120707 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7a79aa82-3c67-425d-adf6-88dd0a26e397 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:42.132426 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7a79aa82-3c67-425d-adf6-88dd0a26e397 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:42.134310 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7a79aa82-3c67-425d-adf6-88dd0a26e397 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:42.135857 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-7a79aa82-3c67-425d-adf6-88dd0a26e397 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1740 microversion: 2.20 time: 0.247711 Jun 30 10:06:42.136953 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 396/777] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:06:41 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1740 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:06:42.252742 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-362fba54-248a-4ee6-9913-220c878c40fe tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Action: 'create', calling method: .version_select at 0x7fc224baf3a0>, body: {"keypair": {"name": "tempest-keypair-1838167340", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNd4Lmwa4iSXFSOv4u9One0ifb/h3CgHAbSMW/sEd9rtXs/kP4clCS3wsOVCrP8rvMyScIuNfqtnfkgpTldz2OF23/OEtC7NydA52BPzpm2OLZj1dMZb6z3b5PBe/EHL2Q=="}} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:06:42.268688 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.quota [None req-362fba54-248a-4ee6-9913-220c878c40fe tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Getting quotas for project 315760a46046430780d7d4741cd8dc7f. Resources: {'key_pairs'} {{(pid=117847) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:06:42.273659 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.quota [None req-362fba54-248a-4ee6-9913-220c878c40fe tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Getting quotas for user 3593c14c5890431d8c4a986132a659b4 and project 315760a46046430780d7d4741cd8dc7f. Resources: {'key_pairs'} {{(pid=117847) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:06:42.302235 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-362fba54-248a-4ee6-9913-220c878c40fe tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.229755 Jun 30 10:06:42.303217 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 382/778] 10.222.0.16 () {60 vars in 1158 bytes} [Thu Jun 30 10:06:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:06:43.158808 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-3a291de5-3ad1-4244-84c3-08b0e90a59dd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:43.160847 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-3a291de5-3ad1-4244-84c3-08b0e90a59dd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:43.173194 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3a291de5-3ad1-4244-84c3-08b0e90a59dd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:43.174212 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3a291de5-3ad1-4244-84c3-08b0e90a59dd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:43.174996 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3a291de5-3ad1-4244-84c3-08b0e90a59dd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:43.175738 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3a291de5-3ad1-4244-84c3-08b0e90a59dd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:43.452687 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-3a291de5-3ad1-4244-84c3-08b0e90a59dd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:43.463682 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-3a291de5-3ad1-4244-84c3-08b0e90a59dd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:43.469206 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-3a291de5-3ad1-4244-84c3-08b0e90a59dd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:43.470791 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-3a291de5-3ad1-4244-84c3-08b0e90a59dd tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1740 microversion: 2.20 time: 0.320051 Jun 30 10:06:43.481612 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 397/779] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:06:43 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1740 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:06:44.074832 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-c8ad9ee4-22f8-4463-9e2a-d30f5d0054b9 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1161736785", "imageRef": "c9dccba6-70d7-4aa8-9b8f-9c88ef1af443", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a532d829-2cb5-43c4-8d0b-23b50c2e25af"}], "security_groups": [{"name": "tempest-securitygroup--321040349"}], "key_name": "tempest-keypair-1838167340", "user_data": "}} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:06:44.225894 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.network.neutron [None req-c8ad9ee4-22f8-4463-9e2a-d30f5d0054b9 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] validate_networks() for [('a532d829-2cb5-43c4-8d0b-23b50c2e25af', None, None, None, None, None)] {{(pid=117847) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 10:06:44.489310 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-4830d45a-2616-48e7-8385-69fae7892a4a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:44.489922 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-4830d45a-2616-48e7-8385-69fae7892a4a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:44.499524 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4830d45a-2616-48e7-8385-69fae7892a4a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:44.500056 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4830d45a-2616-48e7-8385-69fae7892a4a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:44.500832 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4830d45a-2616-48e7-8385-69fae7892a4a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:44.501275 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4830d45a-2616-48e7-8385-69fae7892a4a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:44.872231 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-c8ad9ee4-22f8-4463-9e2a-d30f5d0054b9 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Flavor limits 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 10:06:44.872651 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-c8ad9ee4-22f8-4463-9e2a-d30f5d0054b9 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Image limits 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 10:06:44.873109 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-c8ad9ee4-22f8-4463-9e2a-d30f5d0054b9 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Flavor pref 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 10:06:44.873510 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-c8ad9ee4-22f8-4463-9e2a-d30f5d0054b9 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Image pref 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 10:06:44.873917 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-c8ad9ee4-22f8-4463-9e2a-d30f5d0054b9 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 10:06:44.908765 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c8ad9ee4-22f8-4463-9e2a-d30f5d0054b9 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:44.909731 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c8ad9ee4-22f8-4463-9e2a-d30f5d0054b9 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:44.911365 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c8ad9ee4-22f8-4463-9e2a-d30f5d0054b9 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:44.912053 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c8ad9ee4-22f8-4463-9e2a-d30f5d0054b9 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:44.922147 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-4830d45a-2616-48e7-8385-69fae7892a4a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:44.933029 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-4830d45a-2616-48e7-8385-69fae7892a4a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:44.934554 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-4830d45a-2616-48e7-8385-69fae7892a4a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:44.938621 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.quota [None req-c8ad9ee4-22f8-4463-9e2a-d30f5d0054b9 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Getting quotas for project 315760a46046430780d7d4741cd8dc7f. Resources: {'ram', 'instances', 'cores'} {{(pid=117847) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:06:44.941994 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-4830d45a-2616-48e7-8385-69fae7892a4a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1740 microversion: 2.20 time: 0.456146 Jun 30 10:06:44.945272 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 398/780] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:06:44 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1740 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:06:44.946698 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.quota [None req-c8ad9ee4-22f8-4463-9e2a-d30f5d0054b9 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Getting quotas for user 3593c14c5890431d8c4a986132a659b4 and project 315760a46046430780d7d4741cd8dc7f. Resources: {'ram', 'instances', 'cores'} {{(pid=117847) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:06:44.969201 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-c8ad9ee4-22f8-4463-9e2a-d30f5d0054b9 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Going to run 1 instances... {{(pid=117847) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 10:06:44.972631 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-c8ad9ee4-22f8-4463-9e2a-d30f5d0054b9 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9dccba6-70d7-4aa8-9b8f-9c88ef1af443',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117847) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 10:06:45.047172 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-c8ad9ee4-22f8-4463-9e2a-d30f5d0054b9 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.974939 Jun 30 10:06:45.047616 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 383/781] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jun 30 10:06:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 30 10:06:45.057815 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-11386a95-2220-48e0-ad20-6b08eae8298f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:45.058619 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-11386a95-2220-48e0-ad20-6b08eae8298f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:45.136205 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-11386a95-2220-48e0-ad20-6b08eae8298f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:45.144074 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-11386a95-2220-48e0-ad20-6b08eae8298f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 200 len: 1238 microversion: 2.1 time: 0.090070 Jun 30 10:06:45.153529 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 399/782] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:45 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 1238 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:45.966828 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-9bde6131-1c07-45bf-91cc-e9f9882f46da tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:45.968452 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-9bde6131-1c07-45bf-91cc-e9f9882f46da tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:45.985591 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:06:46.013537 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9bde6131-1c07-45bf-91cc-e9f9882f46da tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:46.014559 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9bde6131-1c07-45bf-91cc-e9f9882f46da tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:46.015809 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9bde6131-1c07-45bf-91cc-e9f9882f46da tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:46.018627 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9bde6131-1c07-45bf-91cc-e9f9882f46da tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:46.163321 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-2fea5aad-4e03-4885-a909-9e592d8bb18c tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:46.163983 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-2fea5aad-4e03-4885-a909-9e592d8bb18c tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:46.198181 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2fea5aad-4e03-4885-a909-9e592d8bb18c tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:46.198655 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2fea5aad-4e03-4885-a909-9e592d8bb18c tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:46.199459 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2fea5aad-4e03-4885-a909-9e592d8bb18c tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:46.199958 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2fea5aad-4e03-4885-a909-9e592d8bb18c tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:46.281069 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-9bde6131-1c07-45bf-91cc-e9f9882f46da tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:46.294346 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-9bde6131-1c07-45bf-91cc-e9f9882f46da tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:46.295959 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-9bde6131-1c07-45bf-91cc-e9f9882f46da tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:46.297296 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-9bde6131-1c07-45bf-91cc-e9f9882f46da tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1740 microversion: 2.20 time: 0.338197 Jun 30 10:06:46.297848 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 384/783] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:06:45 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1740 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:06:46.370399 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-2fea5aad-4e03-4885-a909-9e592d8bb18c tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:46.398306 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-2fea5aad-4e03-4885-a909-9e592d8bb18c tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 200 len: 1290 microversion: 2.1 time: 0.240008 Jun 30 10:06:46.409896 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 400/784] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:46 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 1290 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:47.315736 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-1b4b15cb-7205-4a8d-adb3-a5cf248f758e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:47.316713 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-1b4b15cb-7205-4a8d-adb3-a5cf248f758e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:47.323616 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1b4b15cb-7205-4a8d-adb3-a5cf248f758e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:47.324381 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1b4b15cb-7205-4a8d-adb3-a5cf248f758e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:47.325351 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1b4b15cb-7205-4a8d-adb3-a5cf248f758e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:47.325969 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1b4b15cb-7205-4a8d-adb3-a5cf248f758e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:47.416485 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-a0378936-f242-41e1-abcd-c177dc727386 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:47.417889 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-a0378936-f242-41e1-abcd-c177dc727386 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:47.430258 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:06:47.434942 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a0378936-f242-41e1-abcd-c177dc727386 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:47.435395 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a0378936-f242-41e1-abcd-c177dc727386 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:47.444877 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a0378936-f242-41e1-abcd-c177dc727386 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:47.445387 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a0378936-f242-41e1-abcd-c177dc727386 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:47.712927 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-1b4b15cb-7205-4a8d-adb3-a5cf248f758e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:47.725941 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-1b4b15cb-7205-4a8d-adb3-a5cf248f758e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:47.727862 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-1b4b15cb-7205-4a8d-adb3-a5cf248f758e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:47.730207 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-1b4b15cb-7205-4a8d-adb3-a5cf248f758e tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1740 microversion: 2.20 time: 0.418851 Jun 30 10:06:47.732012 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 385/785] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:06:47 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1740 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:06:47.754205 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-a0378936-f242-41e1-abcd-c177dc727386 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:47.764096 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-a0378936-f242-41e1-abcd-c177dc727386 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 200 len: 1363 microversion: 2.1 time: 0.351835 Jun 30 10:06:47.765703 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 401/786] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:47 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 1363 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:48.406610 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [req-3d46941e-3106-4270-aca6-41e5a87135aa req-f8dabdf0-9fe7-4657-9384-a757806fffc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27789fd0-038a-4d0d-b26f-4b5f5c0d8685", "tag": "7de241b3-2fc5-44bf-8308-4c569553de91"}]} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:06:48.423077 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-3d46941e-3106-4270-aca6-41e5a87135aa req-f8dabdf0-9fe7-4657-9384-a757806fffc8 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:48.423899 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-3d46941e-3106-4270-aca6-41e5a87135aa req-f8dabdf0-9fe7-4657-9384-a757806fffc8 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:48.453144 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.compute.server_external_events [req-3d46941e-3106-4270-aca6-41e5a87135aa req-f8dabdf0-9fe7-4657-9384-a757806fffc8 service nova] Creating event network-changed:7de241b3-2fc5-44bf-8308-4c569553de91 for instance 27789fd0-038a-4d0d-b26f-4b5f5c0d8685 on hv-cinder-84330 Jun 30 10:06:48.458944 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [req-3d46941e-3106-4270-aca6-41e5a87135aa req-f8dabdf0-9fe7-4657-9384-a757806fffc8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059642 Jun 30 10:06:48.460221 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 386/787] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:06:48.749009 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ae881b18-19be-4955-82b1-c4ebab79cb0c tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:48.750537 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-ae881b18-19be-4955-82b1-c4ebab79cb0c tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:48.758562 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ae881b18-19be-4955-82b1-c4ebab79cb0c tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:48.759371 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ae881b18-19be-4955-82b1-c4ebab79cb0c tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:48.760421 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ae881b18-19be-4955-82b1-c4ebab79cb0c tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:48.761073 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ae881b18-19be-4955-82b1-c4ebab79cb0c tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:48.783031 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-6e9629bf-4035-4deb-8c22-f518d51a8f05 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:48.783742 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-6e9629bf-4035-4deb-8c22-f518d51a8f05 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:48.795510 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-6e9629bf-4035-4deb-8c22-f518d51a8f05 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:48.796980 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-6e9629bf-4035-4deb-8c22-f518d51a8f05 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:48.797877 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-6e9629bf-4035-4deb-8c22-f518d51a8f05 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:48.802654 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-6e9629bf-4035-4deb-8c22-f518d51a8f05 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:49.064033 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ae881b18-19be-4955-82b1-c4ebab79cb0c tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:49.072186 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ae881b18-19be-4955-82b1-c4ebab79cb0c tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:49.073752 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ae881b18-19be-4955-82b1-c4ebab79cb0c tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:49.075018 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ae881b18-19be-4955-82b1-c4ebab79cb0c tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1740 microversion: 2.20 time: 0.329885 Jun 30 10:06:49.075765 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 402/788] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:06:48 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1740 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:06:49.084180 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-6e9629bf-4035-4deb-8c22-f518d51a8f05 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:49.091845 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-6e9629bf-4035-4deb-8c22-f518d51a8f05 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 200 len: 1363 microversion: 2.1 time: 0.313193 Jun 30 10:06:49.092450 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 387/789] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:48 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 1363 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:50.097752 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e8a3c267-15ce-48fb-8daa-d54b433af6ca tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:50.098660 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-e8a3c267-15ce-48fb-8daa-d54b433af6ca tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:50.109619 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e8a3c267-15ce-48fb-8daa-d54b433af6ca tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:50.110021 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e8a3c267-15ce-48fb-8daa-d54b433af6ca tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:50.110785 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e8a3c267-15ce-48fb-8daa-d54b433af6ca tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:50.111204 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e8a3c267-15ce-48fb-8daa-d54b433af6ca tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:50.118131 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-a2aa5ff7-5251-40a7-9f31-16c9fcdacd65 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:50.118842 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-a2aa5ff7-5251-40a7-9f31-16c9fcdacd65 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:50.132272 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a2aa5ff7-5251-40a7-9f31-16c9fcdacd65 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:50.132723 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a2aa5ff7-5251-40a7-9f31-16c9fcdacd65 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:50.133570 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a2aa5ff7-5251-40a7-9f31-16c9fcdacd65 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:50.133969 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a2aa5ff7-5251-40a7-9f31-16c9fcdacd65 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:50.445516 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e8a3c267-15ce-48fb-8daa-d54b433af6ca tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:50.454129 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e8a3c267-15ce-48fb-8daa-d54b433af6ca tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:50.455720 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e8a3c267-15ce-48fb-8daa-d54b433af6ca tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:50.457004 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-e8a3c267-15ce-48fb-8daa-d54b433af6ca tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1740 microversion: 2.20 time: 0.365947 Jun 30 10:06:50.467687 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 403/790] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:06:50 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1740 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:06:50.531553 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-a2aa5ff7-5251-40a7-9f31-16c9fcdacd65 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:50.540229 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-a2aa5ff7-5251-40a7-9f31-16c9fcdacd65 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 200 len: 1363 microversion: 2.1 time: 0.432503 Jun 30 10:06:50.540807 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 388/791] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:50 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 1363 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:51.479019 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-36b3f0d3-5268-4a98-97e1-ccf4607d96d2 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:51.479970 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-36b3f0d3-5268-4a98-97e1-ccf4607d96d2 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:51.488813 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-36b3f0d3-5268-4a98-97e1-ccf4607d96d2 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:51.489258 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-36b3f0d3-5268-4a98-97e1-ccf4607d96d2 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:51.490011 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-36b3f0d3-5268-4a98-97e1-ccf4607d96d2 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:51.490435 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-36b3f0d3-5268-4a98-97e1-ccf4607d96d2 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:51.557426 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-20e46264-495e-4a65-81bc-876e7f20a96e tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:51.558040 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-20e46264-495e-4a65-81bc-876e7f20a96e tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:51.565272 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-20e46264-495e-4a65-81bc-876e7f20a96e tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:51.565718 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-20e46264-495e-4a65-81bc-876e7f20a96e tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:51.566476 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-20e46264-495e-4a65-81bc-876e7f20a96e tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:51.566903 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-20e46264-495e-4a65-81bc-876e7f20a96e tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:51.679964 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-36b3f0d3-5268-4a98-97e1-ccf4607d96d2 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:51.689072 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-36b3f0d3-5268-4a98-97e1-ccf4607d96d2 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:51.690601 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-36b3f0d3-5268-4a98-97e1-ccf4607d96d2 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:51.691799 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-36b3f0d3-5268-4a98-97e1-ccf4607d96d2 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1722 microversion: 2.20 time: 0.219389 Jun 30 10:06:51.692408 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 404/792] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:06:51 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:06:51.725680 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-20e46264-495e-4a65-81bc-876e7f20a96e tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:51.733322 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-20e46264-495e-4a65-81bc-876e7f20a96e tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 200 len: 1363 microversion: 2.1 time: 0.179969 Jun 30 10:06:51.733919 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 389/793] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:51 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:52.713336 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-2d3a82ee-1585-4441-9dd4-94bc74cb1382 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:52.714056 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-2d3a82ee-1585-4441-9dd4-94bc74cb1382 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:52.722525 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2d3a82ee-1585-4441-9dd4-94bc74cb1382 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:52.722968 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2d3a82ee-1585-4441-9dd4-94bc74cb1382 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:52.723730 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2d3a82ee-1585-4441-9dd4-94bc74cb1382 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:52.724193 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2d3a82ee-1585-4441-9dd4-94bc74cb1382 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:52.750246 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-90ae3f13-eeb1-4ca0-9515-6a4c3bde8c7f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:52.750857 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-90ae3f13-eeb1-4ca0-9515-6a4c3bde8c7f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:52.764676 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-90ae3f13-eeb1-4ca0-9515-6a4c3bde8c7f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:52.765213 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-90ae3f13-eeb1-4ca0-9515-6a4c3bde8c7f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:52.766083 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-90ae3f13-eeb1-4ca0-9515-6a4c3bde8c7f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:52.766515 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-90ae3f13-eeb1-4ca0-9515-6a4c3bde8c7f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:52.912783 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-2d3a82ee-1585-4441-9dd4-94bc74cb1382 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:52.921993 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-2d3a82ee-1585-4441-9dd4-94bc74cb1382 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:52.924166 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-2d3a82ee-1585-4441-9dd4-94bc74cb1382 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:52.926103 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-2d3a82ee-1585-4441-9dd4-94bc74cb1382 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1722 microversion: 2.20 time: 0.218943 Jun 30 10:06:52.926956 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 405/794] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:06:52 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:06:52.947582 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-90ae3f13-eeb1-4ca0-9515-6a4c3bde8c7f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:52.955668 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-90ae3f13-eeb1-4ca0-9515-6a4c3bde8c7f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 200 len: 1363 microversion: 2.1 time: 0.209353 Jun 30 10:06:52.956376 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 390/795] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:52 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:52.995403 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-890e4725-4ed1-4236-bc6d-0a9caa95b897 req-4271c2c7-0231-4969-b2b3-d5644778697e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ac05989-c74b-4ae8-90c2-b1c16bd45f87", "name": "network-vif-unplugged", "status": "completed", "tag": "b21d9a4d-e7dc-4e74-9943-8abf6db35a29"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:06:53.003794 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-890e4725-4ed1-4236-bc6d-0a9caa95b897 req-4271c2c7-0231-4969-b2b3-d5644778697e service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:53.004251 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-890e4725-4ed1-4236-bc6d-0a9caa95b897 req-4271c2c7-0231-4969-b2b3-d5644778697e service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:53.015239 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-890e4725-4ed1-4236-bc6d-0a9caa95b897 req-4271c2c7-0231-4969-b2b3-d5644778697e service nova] Creating event network-vif-unplugged:b21d9a4d-e7dc-4e74-9943-8abf6db35a29 for instance 4ac05989-c74b-4ae8-90c2-b1c16bd45f87 on hv-cinder-84330 Jun 30 10:06:53.021478 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-890e4725-4ed1-4236-bc6d-0a9caa95b897 req-4271c2c7-0231-4969-b2b3-d5644778697e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029346 Jun 30 10:06:53.022136 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 406/796] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:06:53.948165 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-5d916268-be67-45a4-bd7b-101114c530a1 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:53.948993 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-5d916268-be67-45a4-bd7b-101114c530a1 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:53.960140 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-5d916268-be67-45a4-bd7b-101114c530a1 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:53.960881 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-5d916268-be67-45a4-bd7b-101114c530a1 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:53.962127 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-5d916268-be67-45a4-bd7b-101114c530a1 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:53.962837 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-5d916268-be67-45a4-bd7b-101114c530a1 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:53.974140 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-7d5253da-32ba-48f1-bff4-36429bd4fbd6 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:53.974919 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-7d5253da-32ba-48f1-bff4-36429bd4fbd6 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:53.981531 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7d5253da-32ba-48f1-bff4-36429bd4fbd6 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:53.981966 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7d5253da-32ba-48f1-bff4-36429bd4fbd6 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:53.982710 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7d5253da-32ba-48f1-bff4-36429bd4fbd6 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:53.983131 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7d5253da-32ba-48f1-bff4-36429bd4fbd6 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:54.160685 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-5d916268-be67-45a4-bd7b-101114c530a1 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:54.166154 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7d5253da-32ba-48f1-bff4-36429bd4fbd6 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:54.172887 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-5d916268-be67-45a4-bd7b-101114c530a1 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:54.175253 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-5d916268-be67-45a4-bd7b-101114c530a1 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:54.177079 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-5d916268-be67-45a4-bd7b-101114c530a1 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1665 microversion: 2.20 time: 0.235413 Jun 30 10:06:54.177469 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-7d5253da-32ba-48f1-bff4-36429bd4fbd6 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 200 len: 1363 microversion: 2.1 time: 0.207326 Jun 30 10:06:54.177855 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 391/797] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:06:53 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1665 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:06:54.178248 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 407/798] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:53 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 1363 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:54.198375 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-ecee8916-95c3-4f8b-8363-e9bca667a4ec tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b882553-dee8-4caf-ad48-6e2bc01560b7"}} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:06:54.199358 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-ecee8916-95c3-4f8b-8363-e9bca667a4ec tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:54.205643 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ecee8916-95c3-4f8b-8363-e9bca667a4ec tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:54.206082 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ecee8916-95c3-4f8b-8363-e9bca667a4ec tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:54.206840 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ecee8916-95c3-4f8b-8363-e9bca667a4ec tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:54.207264 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ecee8916-95c3-4f8b-8363-e9bca667a4ec tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:54.221219 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell1:SELECT=100 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:06:54.490488 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-ecee8916-95c3-4f8b-8363-e9bca667a4ec tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "POST /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.295973 Jun 30 10:06:54.491321 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 392/799] 10.222.0.16 () {62 vars in 1363 bytes} [Thu Jun 30 10:06:54 2022] POST /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87/os-volume_attachments => generated 188 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 10:06:54.619295 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-a5018bb5-7c6c-4529-bc84-7f24145690b9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:54.619922 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-a5018bb5-7c6c-4529-bc84-7f24145690b9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:54.628522 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a5018bb5-7c6c-4529-bc84-7f24145690b9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:54.629122 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a5018bb5-7c6c-4529-bc84-7f24145690b9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:54.630191 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a5018bb5-7c6c-4529-bc84-7f24145690b9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:54.630791 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a5018bb5-7c6c-4529-bc84-7f24145690b9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:54.650088 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=100 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:06:54.890785 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-a5018bb5-7c6c-4529-bc84-7f24145690b9 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87/os-volume_attachments/3b882553-dee8-4caf-ad48-6e2bc01560b7" status: 202 len: 0 microversion: 2.20 time: 0.277882 Jun 30 10:06:54.894688 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 408/800] 10.222.0.16 () {60 vars in 1456 bytes} [Thu Jun 30 10:06:54 2022] DELETE /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87/os-volume_attachments/3b882553-dee8-4caf-ad48-6e2bc01560b7 => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 30 10:06:54.950283 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-4264fd41-a4b3-41e0-91e1-dd208fc5f140 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:06:54.951419 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-4264fd41-a4b3-41e0-91e1-dd208fc5f140 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:54.953463 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell0:SELECT=2 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:06:54.960087 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4264fd41-a4b3-41e0-91e1-dd208fc5f140 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:54.960478 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4264fd41-a4b3-41e0-91e1-dd208fc5f140 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:54.961216 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4264fd41-a4b3-41e0-91e1-dd208fc5f140 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:54.961637 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4264fd41-a4b3-41e0-91e1-dd208fc5f140 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:54.962467 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell0:SELECT=10 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:06:55.039282 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-2cd38f49-39db-486c-bf3e-1ffcd6920e09 req-95f5e697-0e21-497c-8e34-2862da65b092 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27789fd0-038a-4d0d-b26f-4b5f5c0d8685", "name": "network-vif-plugged", "status": "completed", "tag": "7de241b3-2fc5-44bf-8308-4c569553de91"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:06:55.048972 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-2cd38f49-39db-486c-bf3e-1ffcd6920e09 req-95f5e697-0e21-497c-8e34-2862da65b092 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:55.049517 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-2cd38f49-39db-486c-bf3e-1ffcd6920e09 req-95f5e697-0e21-497c-8e34-2862da65b092 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:55.060931 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-2cd38f49-39db-486c-bf3e-1ffcd6920e09 req-95f5e697-0e21-497c-8e34-2862da65b092 service nova] Creating event network-vif-plugged:7de241b3-2fc5-44bf-8308-4c569553de91 for instance 27789fd0-038a-4d0d-b26f-4b5f5c0d8685 on hv-cinder-84330 Jun 30 10:06:55.065442 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-4264fd41-a4b3-41e0-91e1-dd208fc5f140 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "POST /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87/action" status: 202 len: 0 microversion: 2.20 time: 0.118841 Jun 30 10:06:55.066346 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 393/801] 10.222.0.16 () {62 vars in 1318 bytes} [Thu Jun 30 10:06:54 2022] POST /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 30 10:06:55.066461 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-2cd38f49-39db-486c-bf3e-1ffcd6920e09 req-95f5e697-0e21-497c-8e34-2862da65b092 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030796 Jun 30 10:06:55.067063 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 409/802] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:06:55.074387 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-2f2c8048-6e28-4c7e-80c4-621c642d350f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:55.074653 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-2f2c8048-6e28-4c7e-80c4-621c642d350f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:55.083027 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2f2c8048-6e28-4c7e-80c4-621c642d350f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:55.083473 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2f2c8048-6e28-4c7e-80c4-621c642d350f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:55.084377 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2f2c8048-6e28-4c7e-80c4-621c642d350f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:55.084803 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2f2c8048-6e28-4c7e-80c4-621c642d350f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:55.195223 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=2 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:06:55.199617 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-62d46352-8be3-4c2b-a8f8-cec9f7193cfe tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:55.200396 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-62d46352-8be3-4c2b-a8f8-cec9f7193cfe tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:55.209843 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-62d46352-8be3-4c2b-a8f8-cec9f7193cfe tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:55.210370 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-62d46352-8be3-4c2b-a8f8-cec9f7193cfe tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:55.211581 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-62d46352-8be3-4c2b-a8f8-cec9f7193cfe tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:55.212041 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-62d46352-8be3-4c2b-a8f8-cec9f7193cfe tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:55.285272 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-2f2c8048-6e28-4c7e-80c4-621c642d350f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:55.300850 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-2f2c8048-6e28-4c7e-80c4-621c642d350f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:55.302586 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-2f2c8048-6e28-4c7e-80c4-621c642d350f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:55.303938 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-2f2c8048-6e28-4c7e-80c4-621c642d350f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1673 microversion: 2.20 time: 0.233660 Jun 30 10:06:55.304708 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 394/803] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:06:55 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1673 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:06:55.406093 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-62d46352-8be3-4c2b-a8f8-cec9f7193cfe tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:55.413818 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-62d46352-8be3-4c2b-a8f8-cec9f7193cfe tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 200 len: 1363 microversion: 2.1 time: 0.219543 Jun 30 10:06:55.414413 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 410/804] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:55 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:06:56.323042 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-e9657361-57b4-4f2b-a161-4d5ffe95c360 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:56.323650 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-e9657361-57b4-4f2b-a161-4d5ffe95c360 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:56.330490 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e9657361-57b4-4f2b-a161-4d5ffe95c360 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:56.330939 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e9657361-57b4-4f2b-a161-4d5ffe95c360 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:56.331719 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e9657361-57b4-4f2b-a161-4d5ffe95c360 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:56.332186 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e9657361-57b4-4f2b-a161-4d5ffe95c360 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:56.430778 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-bd5df1ba-6bb1-4580-b13b-2361c29a6288 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:56.431417 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-bd5df1ba-6bb1-4580-b13b-2361c29a6288 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:56.439394 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bd5df1ba-6bb1-4580-b13b-2361c29a6288 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:56.440244 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bd5df1ba-6bb1-4580-b13b-2361c29a6288 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:56.441365 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bd5df1ba-6bb1-4580-b13b-2361c29a6288 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:56.441802 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bd5df1ba-6bb1-4580-b13b-2361c29a6288 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:56.472982 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-e9657361-57b4-4f2b-a161-4d5ffe95c360 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:56.481308 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-e9657361-57b4-4f2b-a161-4d5ffe95c360 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:56.482857 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-e9657361-57b4-4f2b-a161-4d5ffe95c360 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:56.484316 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-e9657361-57b4-4f2b-a161-4d5ffe95c360 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1675 microversion: 2.20 time: 0.165556 Jun 30 10:06:56.484883 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 395/805] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:06:56 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:06:56.573744 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-bd5df1ba-6bb1-4580-b13b-2361c29a6288 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:56.582425 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-bd5df1ba-6bb1-4580-b13b-2361c29a6288 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 200 len: 1363 microversion: 2.1 time: 0.155603 Jun 30 10:06:56.583020 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 411/806] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:56 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:06:57.503060 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-8d45fec2-efa8-4694-926e-3709319db988 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:57.503655 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-8d45fec2-efa8-4694-926e-3709319db988 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:57.510627 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8d45fec2-efa8-4694-926e-3709319db988 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:57.511073 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8d45fec2-efa8-4694-926e-3709319db988 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:57.511822 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8d45fec2-efa8-4694-926e-3709319db988 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:57.512277 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8d45fec2-efa8-4694-926e-3709319db988 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:57.604042 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-0c0f4b84-7d01-4f55-b9c5-1bd85deefe85 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:57.604636 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-0c0f4b84-7d01-4f55-b9c5-1bd85deefe85 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:57.611814 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0c0f4b84-7d01-4f55-b9c5-1bd85deefe85 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:57.612287 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0c0f4b84-7d01-4f55-b9c5-1bd85deefe85 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:57.613017 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0c0f4b84-7d01-4f55-b9c5-1bd85deefe85 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:57.613688 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0c0f4b84-7d01-4f55-b9c5-1bd85deefe85 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:57.737714 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-8d45fec2-efa8-4694-926e-3709319db988 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:57.746245 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-8d45fec2-efa8-4694-926e-3709319db988 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:57.747731 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-8d45fec2-efa8-4694-926e-3709319db988 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:57.748935 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-8d45fec2-efa8-4694-926e-3709319db988 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1731 microversion: 2.20 time: 0.250008 Jun 30 10:06:57.749572 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 396/807] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:06:57 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1731 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:06:57.861599 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-0c0f4b84-7d01-4f55-b9c5-1bd85deefe85 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:57.872339 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-0c0f4b84-7d01-4f55-b9c5-1bd85deefe85 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 200 len: 1549 microversion: 2.1 time: 0.271848 Jun 30 10:06:57.873194 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 412/808] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:06:57 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 1549 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:06:57.888838 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-2cbcc47a-d2f3-4e30-8ffc-6e62ae10047f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:57.889293 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-2cbcc47a-d2f3-4e30-8ffc-6e62ae10047f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:57.895805 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2cbcc47a-d2f3-4e30-8ffc-6e62ae10047f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:57.896294 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2cbcc47a-d2f3-4e30-8ffc-6e62ae10047f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:57.897058 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2cbcc47a-d2f3-4e30-8ffc-6e62ae10047f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:57.897491 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2cbcc47a-d2f3-4e30-8ffc-6e62ae10047f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:57.999038 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-2cbcc47a-d2f3-4e30-8ffc-6e62ae10047f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.113934 Jun 30 10:06:57.999661 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 397/809] 10.222.0.16 () {58 vars in 1274 bytes} [Thu Jun 30 10:06:57 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685/os-interface => generated 284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:06:58.767353 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ef772b40-4f96-4208-9713-25484005d667 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:06:58.767931 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-ef772b40-4f96-4208-9713-25484005d667 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:06:58.775216 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ef772b40-4f96-4208-9713-25484005d667 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:58.775567 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ef772b40-4f96-4208-9713-25484005d667 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:58.776652 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ef772b40-4f96-4208-9713-25484005d667 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:58.777253 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ef772b40-4f96-4208-9713-25484005d667 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:58.991389 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ef772b40-4f96-4208-9713-25484005d667 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:59.000800 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ef772b40-4f96-4208-9713-25484005d667 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:59.009243 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ef772b40-4f96-4208-9713-25484005d667 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:06:59.011114 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ef772b40-4f96-4208-9713-25484005d667 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1731 microversion: 2.20 time: 0.248439 Jun 30 10:06:59.011862 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 413/810] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:06:58 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1731 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:06:59.149731 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [req-d60476f9-e8d4-4cf1-8f0e-245719eb57d0 req-2fa2abd1-4ed5-4475-baed-4eaddd6df381 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27789fd0-038a-4d0d-b26f-4b5f5c0d8685", "tag": "7de241b3-2fc5-44bf-8308-4c569553de91"}]} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:06:59.170684 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-d60476f9-e8d4-4cf1-8f0e-245719eb57d0 req-2fa2abd1-4ed5-4475-baed-4eaddd6df381 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:06:59.171318 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-d60476f9-e8d4-4cf1-8f0e-245719eb57d0 req-2fa2abd1-4ed5-4475-baed-4eaddd6df381 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:06:59.183420 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.compute.server_external_events [req-d60476f9-e8d4-4cf1-8f0e-245719eb57d0 req-2fa2abd1-4ed5-4475-baed-4eaddd6df381 service nova] Creating event network-changed:7de241b3-2fc5-44bf-8308-4c569553de91 for instance 27789fd0-038a-4d0d-b26f-4b5f5c0d8685 on hv-cinder-84330 Jun 30 10:06:59.190268 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [req-d60476f9-e8d4-4cf1-8f0e-245719eb57d0 req-2fa2abd1-4ed5-4475-baed-4eaddd6df381 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044204 Jun 30 10:06:59.191269 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 398/811] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:07:00.029764 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-31551efa-7a6c-4739-8881-2f3c0d589b58 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:00.030447 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-31551efa-7a6c-4739-8881-2f3c0d589b58 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:00.037560 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-31551efa-7a6c-4739-8881-2f3c0d589b58 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:00.038171 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-31551efa-7a6c-4739-8881-2f3c0d589b58 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:00.045009 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-31551efa-7a6c-4739-8881-2f3c0d589b58 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:00.046076 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-31551efa-7a6c-4739-8881-2f3c0d589b58 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:00.230811 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-31551efa-7a6c-4739-8881-2f3c0d589b58 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:00.239558 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-31551efa-7a6c-4739-8881-2f3c0d589b58 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:00.241356 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-31551efa-7a6c-4739-8881-2f3c0d589b58 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:00.242505 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-31551efa-7a6c-4739-8881-2f3c0d589b58 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1731 microversion: 2.20 time: 0.216651 Jun 30 10:07:00.243049 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 414/812] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:07:00 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1731 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:07:01.262495 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-b1dff8c9-554b-455e-88fd-c28bd4cb8fdc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:01.263169 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-b1dff8c9-554b-455e-88fd-c28bd4cb8fdc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:01.275844 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b1dff8c9-554b-455e-88fd-c28bd4cb8fdc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:01.276315 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b1dff8c9-554b-455e-88fd-c28bd4cb8fdc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:01.277084 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b1dff8c9-554b-455e-88fd-c28bd4cb8fdc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:01.277511 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b1dff8c9-554b-455e-88fd-c28bd4cb8fdc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:01.429602 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-b1dff8c9-554b-455e-88fd-c28bd4cb8fdc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:01.438130 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-b1dff8c9-554b-455e-88fd-c28bd4cb8fdc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:01.439614 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-b1dff8c9-554b-455e-88fd-c28bd4cb8fdc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:01.440791 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-b1dff8c9-554b-455e-88fd-c28bd4cb8fdc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1731 microversion: 2.20 time: 0.183229 Jun 30 10:07:01.441342 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 399/813] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:07:01 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1731 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:07:02.459806 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-d6c3eb85-e02e-4266-a895-5b5692cdb638 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:02.460687 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-d6c3eb85-e02e-4266-a895-5b5692cdb638 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:02.468604 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d6c3eb85-e02e-4266-a895-5b5692cdb638 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:02.468978 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d6c3eb85-e02e-4266-a895-5b5692cdb638 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:02.469738 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d6c3eb85-e02e-4266-a895-5b5692cdb638 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:02.470161 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d6c3eb85-e02e-4266-a895-5b5692cdb638 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:02.608520 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-d6c3eb85-e02e-4266-a895-5b5692cdb638 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:02.617245 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-d6c3eb85-e02e-4266-a895-5b5692cdb638 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:02.618739 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-d6c3eb85-e02e-4266-a895-5b5692cdb638 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:02.619922 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-d6c3eb85-e02e-4266-a895-5b5692cdb638 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1731 microversion: 2.20 time: 0.164298 Jun 30 10:07:02.620672 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 415/814] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:07:02 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:07:03.637867 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-eed4388c-779e-4d68-835e-d97995a4b2cc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:03.638469 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-eed4388c-779e-4d68-835e-d97995a4b2cc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:03.645320 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-eed4388c-779e-4d68-835e-d97995a4b2cc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:03.645763 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-eed4388c-779e-4d68-835e-d97995a4b2cc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:03.646507 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-eed4388c-779e-4d68-835e-d97995a4b2cc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:03.646928 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-eed4388c-779e-4d68-835e-d97995a4b2cc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:03.789010 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-eed4388c-779e-4d68-835e-d97995a4b2cc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:03.797904 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-eed4388c-779e-4d68-835e-d97995a4b2cc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:03.799427 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-eed4388c-779e-4d68-835e-d97995a4b2cc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:03.800609 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-eed4388c-779e-4d68-835e-d97995a4b2cc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1731 microversion: 2.20 time: 0.166760 Jun 30 10:07:03.801131 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 400/815] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:07:03 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:07:04.821682 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-cfe39176-c4f9-4d4e-8917-0b6ab7073f82 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:04.822341 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-cfe39176-c4f9-4d4e-8917-0b6ab7073f82 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:04.830927 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cfe39176-c4f9-4d4e-8917-0b6ab7073f82 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:04.831367 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cfe39176-c4f9-4d4e-8917-0b6ab7073f82 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:04.832141 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cfe39176-c4f9-4d4e-8917-0b6ab7073f82 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:04.832566 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cfe39176-c4f9-4d4e-8917-0b6ab7073f82 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:04.990520 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-cfe39176-c4f9-4d4e-8917-0b6ab7073f82 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:05.002059 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-cfe39176-c4f9-4d4e-8917-0b6ab7073f82 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:05.003676 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-cfe39176-c4f9-4d4e-8917-0b6ab7073f82 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:05.005082 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-cfe39176-c4f9-4d4e-8917-0b6ab7073f82 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1731 microversion: 2.20 time: 0.189464 Jun 30 10:07:05.005854 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 416/816] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:07:04 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1731 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:07:06.023650 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-050df877-1672-46be-8308-582f6f83a4e3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:06.024280 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-050df877-1672-46be-8308-582f6f83a4e3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:06.031538 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-050df877-1672-46be-8308-582f6f83a4e3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:06.031993 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-050df877-1672-46be-8308-582f6f83a4e3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:06.032769 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-050df877-1672-46be-8308-582f6f83a4e3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:06.033200 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-050df877-1672-46be-8308-582f6f83a4e3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:06.174637 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-050df877-1672-46be-8308-582f6f83a4e3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:06.183716 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-050df877-1672-46be-8308-582f6f83a4e3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:06.185528 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-050df877-1672-46be-8308-582f6f83a4e3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:06.187543 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-050df877-1672-46be-8308-582f6f83a4e3 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1731 microversion: 2.20 time: 0.167726 Jun 30 10:07:06.188705 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 401/817] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:07:06 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 10:07:06.532144 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-a1d98afe-aad1-4a67-9d00-450f069c1104 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:06.532740 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-a1d98afe-aad1-4a67-9d00-450f069c1104 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: cc0df4f5-54ea-46ae-837b-66e0a4c09443] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:06.539584 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a1d98afe-aad1-4a67-9d00-450f069c1104 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:06.540072 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a1d98afe-aad1-4a67-9d00-450f069c1104 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:06.540852 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a1d98afe-aad1-4a67-9d00-450f069c1104 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:06.541289 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a1d98afe-aad1-4a67-9d00-450f069c1104 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:06.571831 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-a1d98afe-aad1-4a67-9d00-450f069c1104 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443/ips" status: 200 len: 151 microversion: 2.1 time: 0.043613 Jun 30 10:07:06.572434 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 417/818] 10.222.0.16 () {58 vars in 1247 bytes} [Thu Jun 30 10:07:06 2022] GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443/ips => generated 151 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:07:07.206312 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-72249a83-edaa-4f55-bebd-af491f816c8f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:07.207009 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-72249a83-edaa-4f55-bebd-af491f816c8f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:07.213464 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-72249a83-edaa-4f55-bebd-af491f816c8f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:07.213906 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-72249a83-edaa-4f55-bebd-af491f816c8f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:07.214669 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-72249a83-edaa-4f55-bebd-af491f816c8f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:07.215099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-72249a83-edaa-4f55-bebd-af491f816c8f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:07.356976 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-72249a83-edaa-4f55-bebd-af491f816c8f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:07.366131 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-72249a83-edaa-4f55-bebd-af491f816c8f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:07.367647 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-72249a83-edaa-4f55-bebd-af491f816c8f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:07.368832 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-72249a83-edaa-4f55-bebd-af491f816c8f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1731 microversion: 2.20 time: 0.166469 Jun 30 10:07:07.369403 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 402/819] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:07:07 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:07:07.937077 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-45053a6b-1114-4817-b2f6-19d5983d1948 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c5d727c-967d-48a6-b1b7-83547e1eb32b"}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:07:07.938406 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-45053a6b-1114-4817-b2f6-19d5983d1948 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: cc0df4f5-54ea-46ae-837b-66e0a4c09443] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:07.946536 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-45053a6b-1114-4817-b2f6-19d5983d1948 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:07.947206 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-45053a6b-1114-4817-b2f6-19d5983d1948 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:07.948404 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-45053a6b-1114-4817-b2f6-19d5983d1948 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:07.948940 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-45053a6b-1114-4817-b2f6-19d5983d1948 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:08.389124 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-c5429a03-1ce5-4ca1-8f79-de48289a2d74 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:08.390176 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-c5429a03-1ce5-4ca1-8f79-de48289a2d74 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:08.398236 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c5429a03-1ce5-4ca1-8f79-de48289a2d74 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:08.398771 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c5429a03-1ce5-4ca1-8f79-de48289a2d74 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:08.399661 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c5429a03-1ce5-4ca1-8f79-de48289a2d74 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:08.400206 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c5429a03-1ce5-4ca1-8f79-de48289a2d74 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:08.535675 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-c5429a03-1ce5-4ca1-8f79-de48289a2d74 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:08.547847 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-c5429a03-1ce5-4ca1-8f79-de48289a2d74 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:08.549371 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-c5429a03-1ce5-4ca1-8f79-de48289a2d74 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:08.550521 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-c5429a03-1ce5-4ca1-8f79-de48289a2d74 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1731 microversion: 2.20 time: 0.166095 Jun 30 10:07:08.551052 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 403/820] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:07:08 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:07:08.977950 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-45053a6b-1114-4817-b2f6-19d5983d1948 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "POST /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.045161 Jun 30 10:07:08.978558 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 418/821] 10.222.0.16 () {60 vars in 1322 bytes} [Thu Jun 30 10:07:07 2022] POST /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443/os-volume_attachments => generated 194 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:07:09.572946 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-c0a5b98f-d314-4624-86e7-241edda1f3de tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:09.573920 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-c0a5b98f-d314-4624-86e7-241edda1f3de tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:09.582093 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c0a5b98f-d314-4624-86e7-241edda1f3de tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:09.582529 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c0a5b98f-d314-4624-86e7-241edda1f3de tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:09.583282 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c0a5b98f-d314-4624-86e7-241edda1f3de tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:09.583708 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c0a5b98f-d314-4624-86e7-241edda1f3de tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:09.984700 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-c0a5b98f-d314-4624-86e7-241edda1f3de tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:09.996133 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-c0a5b98f-d314-4624-86e7-241edda1f3de tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:09.997598 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-c0a5b98f-d314-4624-86e7-241edda1f3de tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:09.998786 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-c0a5b98f-d314-4624-86e7-241edda1f3de tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1731 microversion: 2.20 time: 0.432177 Jun 30 10:07:09.999357 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 404/822] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:07:09 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1731 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:07:11.018531 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-55e6568b-d49e-4795-b9e3-4a92e5698e70 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:11.019193 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-55e6568b-d49e-4795-b9e3-4a92e5698e70 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:11.025980 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-55e6568b-d49e-4795-b9e3-4a92e5698e70 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:11.026420 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-55e6568b-d49e-4795-b9e3-4a92e5698e70 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:11.027177 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-55e6568b-d49e-4795-b9e3-4a92e5698e70 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:11.027602 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-55e6568b-d49e-4795-b9e3-4a92e5698e70 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:11.160677 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-55e6568b-d49e-4795-b9e3-4a92e5698e70 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:11.168961 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-55e6568b-d49e-4795-b9e3-4a92e5698e70 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:11.170773 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-55e6568b-d49e-4795-b9e3-4a92e5698e70 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:11.171958 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-55e6568b-d49e-4795-b9e3-4a92e5698e70 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1731 microversion: 2.20 time: 0.158560 Jun 30 10:07:11.172522 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 419/823] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:07:11 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:07:12.191740 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-8b39921f-6438-46bd-b098-cf5c8df04b5a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:12.192465 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-8b39921f-6438-46bd-b098-cf5c8df04b5a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:12.199042 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8b39921f-6438-46bd-b098-cf5c8df04b5a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:12.199705 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8b39921f-6438-46bd-b098-cf5c8df04b5a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:12.200499 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8b39921f-6438-46bd-b098-cf5c8df04b5a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:12.200900 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8b39921f-6438-46bd-b098-cf5c8df04b5a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:12.336086 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-8b39921f-6438-46bd-b098-cf5c8df04b5a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:12.346386 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-8b39921f-6438-46bd-b098-cf5c8df04b5a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:12.347915 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-8b39921f-6438-46bd-b098-cf5c8df04b5a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:12.349065 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-8b39921f-6438-46bd-b098-cf5c8df04b5a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1731 microversion: 2.20 time: 0.161269 Jun 30 10:07:12.349620 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 405/824] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:07:12 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:07:13.097479 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-15cdf694-ddd1-4916-a2d3-6c3c61c3154b req-aabdfeed-4492-4ad5-b5ae-396fbf817c3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ac05989-c74b-4ae8-90c2-b1c16bd45f87", "name": "network-vif-plugged", "status": "completed", "tag": "b21d9a4d-e7dc-4e74-9943-8abf6db35a29"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:07:13.106640 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-15cdf694-ddd1-4916-a2d3-6c3c61c3154b req-aabdfeed-4492-4ad5-b5ae-396fbf817c3a service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:13.107073 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-15cdf694-ddd1-4916-a2d3-6c3c61c3154b req-aabdfeed-4492-4ad5-b5ae-396fbf817c3a service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:13.119758 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-15cdf694-ddd1-4916-a2d3-6c3c61c3154b req-aabdfeed-4492-4ad5-b5ae-396fbf817c3a service nova] Creating event network-vif-plugged:b21d9a4d-e7dc-4e74-9943-8abf6db35a29 for instance 4ac05989-c74b-4ae8-90c2-b1c16bd45f87 on hv-cinder-84330 Jun 30 10:07:13.125087 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-15cdf694-ddd1-4916-a2d3-6c3c61c3154b req-aabdfeed-4492-4ad5-b5ae-396fbf817c3a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031249 Jun 30 10:07:13.125892 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 420/825] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:07:13.366753 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-8cc8c5f1-1982-453e-8aa9-3aadd4c29eba tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:13.367433 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-8cc8c5f1-1982-453e-8aa9-3aadd4c29eba tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:13.374131 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8cc8c5f1-1982-453e-8aa9-3aadd4c29eba tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:13.374569 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8cc8c5f1-1982-453e-8aa9-3aadd4c29eba tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:13.375487 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8cc8c5f1-1982-453e-8aa9-3aadd4c29eba tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:13.375727 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-8cc8c5f1-1982-453e-8aa9-3aadd4c29eba tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:13.391331 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:07:13.510330 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-8cc8c5f1-1982-453e-8aa9-3aadd4c29eba tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:13.519318 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-8cc8c5f1-1982-453e-8aa9-3aadd4c29eba tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:13.520856 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-8cc8c5f1-1982-453e-8aa9-3aadd4c29eba tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:13.522005 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-8cc8c5f1-1982-453e-8aa9-3aadd4c29eba tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1731 microversion: 2.20 time: 0.159216 Jun 30 10:07:13.522568 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 406/826] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:07:13 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:07:14.545971 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f002dacb-3efe-435a-80bc-62ab768ceb36 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:14.546989 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f002dacb-3efe-435a-80bc-62ab768ceb36 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:14.556120 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f002dacb-3efe-435a-80bc-62ab768ceb36 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:14.556555 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f002dacb-3efe-435a-80bc-62ab768ceb36 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:14.557298 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f002dacb-3efe-435a-80bc-62ab768ceb36 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:14.557724 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f002dacb-3efe-435a-80bc-62ab768ceb36 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:14.693145 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f002dacb-3efe-435a-80bc-62ab768ceb36 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:14.701839 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f002dacb-3efe-435a-80bc-62ab768ceb36 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:14.703345 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f002dacb-3efe-435a-80bc-62ab768ceb36 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:14.704527 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f002dacb-3efe-435a-80bc-62ab768ceb36 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1731 microversion: 2.20 time: 0.166101 Jun 30 10:07:14.705069 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 421/827] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:07:14 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:07:15.723969 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-ee7469bb-0800-4c89-980f-a17750b60105 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:15.724595 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-ee7469bb-0800-4c89-980f-a17750b60105 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:15.738916 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ee7469bb-0800-4c89-980f-a17750b60105 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:15.739360 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ee7469bb-0800-4c89-980f-a17750b60105 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:15.740157 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ee7469bb-0800-4c89-980f-a17750b60105 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:15.740582 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ee7469bb-0800-4c89-980f-a17750b60105 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:15.878518 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-ee7469bb-0800-4c89-980f-a17750b60105 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:15.886891 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-ee7469bb-0800-4c89-980f-a17750b60105 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:15.888554 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-ee7469bb-0800-4c89-980f-a17750b60105 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:15.889777 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-ee7469bb-0800-4c89-980f-a17750b60105 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1718 microversion: 2.20 time: 0.170112 Jun 30 10:07:15.890361 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 407/828] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:07:15 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1718 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:07:16.620863 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-68616c93-e8c3-460b-83f7-7c3d843fa250 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:16.621380 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-68616c93-e8c3-460b-83f7-7c3d843fa250 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: cc0df4f5-54ea-46ae-837b-66e0a4c09443] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:16.629091 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-68616c93-e8c3-460b-83f7-7c3d843fa250 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:16.629541 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-68616c93-e8c3-460b-83f7-7c3d843fa250 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:16.630303 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-68616c93-e8c3-460b-83f7-7c3d843fa250 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:16.630749 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-68616c93-e8c3-460b-83f7-7c3d843fa250 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:16.714080 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:07:16.718288 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.objects.instance [None req-68616c93-e8c3-460b-83f7-7c3d843fa250 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lazy-loading 'services' on Instance uuid cc0df4f5-54ea-46ae-837b-66e0a4c09443 {{(pid=117846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:07:16.956828 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-68616c93-e8c3-460b-83f7-7c3d843fa250 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443/os-volume_attachments/9c5d727c-967d-48a6-b1b7-83547e1eb32b" status: 202 len: 0 microversion: 2.1 time: 0.339789 Jun 30 10:07:16.957844 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 422/829] 10.222.0.16 () {58 vars in 1415 bytes} [Thu Jun 30 10:07:16 2022] DELETE /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443/os-volume_attachments/9c5d727c-967d-48a6-b1b7-83547e1eb32b => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:07:16.966245 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-05941c84-24b5-4931-9435-24f7c24ba80b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:16.967268 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-05941c84-24b5-4931-9435-24f7c24ba80b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: cc0df4f5-54ea-46ae-837b-66e0a4c09443] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:16.970217 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_api:SELECT=50 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:07:16.976732 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-05941c84-24b5-4931-9435-24f7c24ba80b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:16.977382 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-05941c84-24b5-4931-9435-24f7c24ba80b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:16.978185 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-05941c84-24b5-4931-9435-24f7c24ba80b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:16.978637 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-05941c84-24b5-4931-9435-24f7c24ba80b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:17.011650 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-05941c84-24b5-4931-9435-24f7c24ba80b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049408 Jun 30 10:07:17.012241 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 408/830] 10.222.0.16 () {58 vars in 1301 bytes} [Thu Jun 30 10:07:16 2022] GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:07:18.024288 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-815a632c-2f55-4d56-8979-2099f9f5e4e6 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:18.025239 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-815a632c-2f55-4d56-8979-2099f9f5e4e6 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: cc0df4f5-54ea-46ae-837b-66e0a4c09443] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:18.027212 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=44 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:07:18.033261 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-815a632c-2f55-4d56-8979-2099f9f5e4e6 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:18.033697 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-815a632c-2f55-4d56-8979-2099f9f5e4e6 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:18.034471 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-815a632c-2f55-4d56-8979-2099f9f5e4e6 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:18.034898 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-815a632c-2f55-4d56-8979-2099f9f5e4e6 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:18.064779 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-815a632c-2f55-4d56-8979-2099f9f5e4e6 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045525 Jun 30 10:07:18.065336 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 423/831] 10.222.0.16 () {58 vars in 1301 bytes} [Thu Jun 30 10:07:18 2022] GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 10:07:18.122146 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-51e01d6f-1565-4d56-a417-e42fc1e36738 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:18.122656 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-51e01d6f-1565-4d56-a417-e42fc1e36738 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: cc0df4f5-54ea-46ae-837b-66e0a4c09443] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:18.129558 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-51e01d6f-1565-4d56-a417-e42fc1e36738 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:18.130054 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-51e01d6f-1565-4d56-a417-e42fc1e36738 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:18.130846 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-51e01d6f-1565-4d56-a417-e42fc1e36738 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:18.131296 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-51e01d6f-1565-4d56-a417-e42fc1e36738 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:18.156866 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-51e01d6f-1565-4d56-a417-e42fc1e36738 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: cc0df4f5-54ea-46ae-837b-66e0a4c09443] Going to try to terminate instance {{(pid=117847) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 10:07:18.238560 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-51e01d6f-1565-4d56-a417-e42fc1e36738 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443" status: 204 len: 0 microversion: 2.1 time: 0.119956 Jun 30 10:07:18.239108 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 409/832] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 10:07:18 2022] DELETE /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 10:07:18.247287 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-936a34bc-a9fb-4341-ac37-a8f8ee54566e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:18.247941 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-936a34bc-a9fb-4341-ac37-a8f8ee54566e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: cc0df4f5-54ea-46ae-837b-66e0a4c09443] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:18.254232 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-936a34bc-a9fb-4341-ac37-a8f8ee54566e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:18.254675 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-936a34bc-a9fb-4341-ac37-a8f8ee54566e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:18.255423 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-936a34bc-a9fb-4341-ac37-a8f8ee54566e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:18.255847 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-936a34bc-a9fb-4341-ac37-a8f8ee54566e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:18.397474 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-936a34bc-a9fb-4341-ac37-a8f8ee54566e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:18.409470 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-936a34bc-a9fb-4341-ac37-a8f8ee54566e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443" status: 200 len: 1683 microversion: 2.1 time: 0.165899 Jun 30 10:07:18.410054 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 424/833] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:07:18 2022] GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:07:19.432202 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-7c091655-8bf8-48ff-a6c5-b61459d9c49e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:19.433346 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-7c091655-8bf8-48ff-a6c5-b61459d9c49e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: cc0df4f5-54ea-46ae-837b-66e0a4c09443] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:19.441710 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7c091655-8bf8-48ff-a6c5-b61459d9c49e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:19.442161 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7c091655-8bf8-48ff-a6c5-b61459d9c49e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:19.442917 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7c091655-8bf8-48ff-a6c5-b61459d9c49e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:19.443346 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7c091655-8bf8-48ff-a6c5-b61459d9c49e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:19.586604 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-7c091655-8bf8-48ff-a6c5-b61459d9c49e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:19.595044 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-7c091655-8bf8-48ff-a6c5-b61459d9c49e tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443" status: 200 len: 1683 microversion: 2.1 time: 0.170158 Jun 30 10:07:19.595592 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 410/834] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:07:19 2022] GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443 => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:07:20.612323 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-78b3c2aa-316d-4a28-8372-ccfabad1f520 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:20.612936 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-78b3c2aa-316d-4a28-8372-ccfabad1f520 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: cc0df4f5-54ea-46ae-837b-66e0a4c09443] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:20.619741 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-78b3c2aa-316d-4a28-8372-ccfabad1f520 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:20.620213 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-78b3c2aa-316d-4a28-8372-ccfabad1f520 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:20.620966 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-78b3c2aa-316d-4a28-8372-ccfabad1f520 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:20.621389 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-78b3c2aa-316d-4a28-8372-ccfabad1f520 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:20.701013 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-78b3c2aa-316d-4a28-8372-ccfabad1f520 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ad2c4909c49a6b3df8ece333e70b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e55dd4580184f158efedbad5dc6e8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:20.709082 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-78b3c2aa-316d-4a28-8372-ccfabad1f520 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443" status: 200 len: 1615 microversion: 2.1 time: 0.100713 Jun 30 10:07:20.709643 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 425/835] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:07:20 2022] GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443 => generated 1615 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:07:20.740301 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [req-040eeef5-81cb-4971-a2dc-def133023092 req-51079d21-8c3d-4fed-8848-6ef5983be81b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc0df4f5-54ea-46ae-837b-66e0a4c09443", "name": "network-vif-deleted", "tag": "c290f600-5bbc-467b-a453-efdf017e12bb"}]} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:07:20.752998 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-040eeef5-81cb-4971-a2dc-def133023092 req-51079d21-8c3d-4fed-8848-6ef5983be81b service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:20.753469 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-040eeef5-81cb-4971-a2dc-def133023092 req-51079d21-8c3d-4fed-8848-6ef5983be81b service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:20.766558 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.compute.server_external_events [req-040eeef5-81cb-4971-a2dc-def133023092 req-51079d21-8c3d-4fed-8848-6ef5983be81b service nova] Creating event network-vif-deleted:c290f600-5bbc-467b-a453-efdf017e12bb for instance cc0df4f5-54ea-46ae-837b-66e0a4c09443 on hv-cinder-84330 Jun 30 10:07:20.772309 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [req-040eeef5-81cb-4971-a2dc-def133023092 req-51079d21-8c3d-4fed-8848-6ef5983be81b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041749 Jun 30 10:07:20.773186 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 411/836] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:07:21.726988 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-3e2ec84f-4d0b-4757-82fd-e7ae96df8dce tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:21.727499 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-3e2ec84f-4d0b-4757-82fd-e7ae96df8dce tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: cc0df4f5-54ea-46ae-837b-66e0a4c09443] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:21.734393 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3e2ec84f-4d0b-4757-82fd-e7ae96df8dce tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:21.734866 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3e2ec84f-4d0b-4757-82fd-e7ae96df8dce tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:21.735615 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3e2ec84f-4d0b-4757-82fd-e7ae96df8dce tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:21.736074 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3e2ec84f-4d0b-4757-82fd-e7ae96df8dce tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:21.750082 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-3e2ec84f-4d0b-4757-82fd-e7ae96df8dce tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] HTTP exception thrown: Instance cc0df4f5-54ea-46ae-837b-66e0a4c09443 could not be found. Jun 30 10:07:21.751899 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-3e2ec84f-4d0b-4757-82fd-e7ae96df8dce tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Request method failure captured: Jun 30 10:07:21.751899 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: request: GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443 HTTP/1.1 Jun 30 10:07:21.751899 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept: application/json Jun 30 10:07:21.751899 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jun 30 10:07:21.751899 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Connection: close Jun 30 10:07:21.751899 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jun 30 10:07:21.751899 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jun 30 10:07:21.751899 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Host: 10.222.0.16 Jun 30 10:07:21.751899 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jun 30 10:07:21.751899 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jun 30 10:07:21.751899 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABivXRKWOm8okSqawQyEyFIlPPo5ED3-MkteEmCjIwaTuHRpOC0yz7t-S9pF6F_OHxcNFTgq2ZVvCBW8WpcDzubzrkM7lZXCNWSzcj1P8TCpyHfDpEvKKwyetYBPaKEvw3fBqcARKuB5F-oWIrvkHJpnEC8cyolAJOOfEpEG7HP2E8WCR8 Jun 30 10:07:21.751899 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jun 30 10:07:21.751899 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jun 30 10:07:21.751899 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jun 30 10:07:21.751899 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jun 30 10:07:21.751899 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jun 30 10:07:21.751899 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jun 30 10:07:21.751899 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Id: 2e55dd4580184f158efedbad5dc6e8fb Jun 30 10:07:21.751899 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-AttachVolumeNegativeTest-821277988 Jun 30 10:07:21.751899 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Role: reader,member Jun 30 10:07:21.751899 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Roles: reader,member Jun 30 10:07:21.755147 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:07:21.755147 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-AttachVolumeNegativeTest-821277988 Jun 30 10:07:21.755147 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 2e55dd4580184f158efedbad5dc6e8fb Jun 30 10:07:21.755147 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-821277988 Jun 30 10:07:21.755147 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User: tempest-AttachVolumeNegativeTest-821277988-project Jun 30 10:07:21.755147 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jun 30 10:07:21.755147 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jun 30 10:07:21.755147 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Id: 4e9ad2c4909c49a6b3df8ece333e70b5 Jun 30 10:07:21.755147 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-AttachVolumeNegativeTest-821277988-project Jun 30 10:07:21.755147 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: method: > Jun 30 10:07:21.755147 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: exception: Instance cc0df4f5-54ea-46ae-837b-66e0a4c09443 could not be found. Jun 30 10:07:21.755147 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: action_args: {'id': 'cc0df4f5-54ea-46ae-837b-66e0a4c09443'} Jun 30 10:07:21.756097 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:07:21.756097 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:07:21.756097 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:07:21.756097 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:07:21.756097 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:07:21.756097 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:07:21.756097 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:07:21.756097 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:07:21.756097 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:07:21.756097 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:07:21.756097 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc0df4f5-54ea-46ae-837b-66e0a4c09443 could not be found. Jun 30 10:07:21.756097 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:07:21.756097 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:07:21.756097 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:07:21.756097 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:07:21.756097 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:07:21.756097 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:07:21.756097 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:07:21.756097 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:07:21.756097 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:07:21.757469 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:07:21.757469 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:07:21.757469 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:07:21.757469 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:07:21.757469 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:07:21.757469 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:07:21.757469 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:07:21.757469 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc0df4f5-54ea-46ae-837b-66e0a4c09443 could not be found. Jun 30 10:07:21.757469 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:07:21.757469 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:07:21.757469 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:07:21.757469 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:07:21.757469 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:07:21.757469 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:07:21.757469 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:07:21.757469 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:07:21.757469 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc0df4f5-54ea-46ae-837b-66e0a4c09443 could not be found. Jun 30 10:07:21.757469 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:07:21.758653 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-3e2ec84f-4d0b-4757-82fd-e7ae96df8dce tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Returning 404 to user: Instance cc0df4f5-54ea-46ae-837b-66e0a4c09443 could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:07:21.758653 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-3e2ec84f-4d0b-4757-82fd-e7ae96df8dce tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443" status: 404 len: 111 microversion: 2.1 time: 0.032220 Jun 30 10:07:21.758653 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 426/837] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:07:21 2022] GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:07:21.765205 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-6f5fd406-48e5-4781-b034-ad9dd95fc4d4 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '.version_select at 0x7fc224c42d30>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:21.784610 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-6f5fd406-48e5-4781-b034-ad9dd95fc4d4 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-116394264" status: 202 len: 0 microversion: 2.1 time: 0.024199 Jun 30 10:07:21.785184 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 412/838] 10.222.0.16 () {58 vars in 1217 bytes} [Thu Jun 30 10:07:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-116394264 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:07:23.562192 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-d6d7b0e1-a4b1-47cd-93cb-9ccacf13c89a tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:23.562688 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-d6d7b0e1-a4b1-47cd-93cb-9ccacf13c89a tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: cc0df4f5-54ea-46ae-837b-66e0a4c09443] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:23.571195 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d6d7b0e1-a4b1-47cd-93cb-9ccacf13c89a tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:23.571641 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d6d7b0e1-a4b1-47cd-93cb-9ccacf13c89a tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:23.572443 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d6d7b0e1-a4b1-47cd-93cb-9ccacf13c89a tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:23.572872 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d6d7b0e1-a4b1-47cd-93cb-9ccacf13c89a tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:23.587519 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-d6d7b0e1-a4b1-47cd-93cb-9ccacf13c89a tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] HTTP exception thrown: Instance cc0df4f5-54ea-46ae-837b-66e0a4c09443 could not be found. Jun 30 10:07:23.589203 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-d6d7b0e1-a4b1-47cd-93cb-9ccacf13c89a tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Request method failure captured: Jun 30 10:07:23.589203 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: request: DELETE /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443 HTTP/1.1 Jun 30 10:07:23.589203 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept: application/json Jun 30 10:07:23.589203 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jun 30 10:07:23.589203 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Connection: close Jun 30 10:07:23.589203 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jun 30 10:07:23.589203 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jun 30 10:07:23.589203 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Host: 10.222.0.16 Jun 30 10:07:23.589203 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jun 30 10:07:23.589203 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jun 30 10:07:23.589203 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABivXRKWOm8okSqawQyEyFIlPPo5ED3-MkteEmCjIwaTuHRpOC0yz7t-S9pF6F_OHxcNFTgq2ZVvCBW8WpcDzubzrkM7lZXCNWSzcj1P8TCpyHfDpEvKKwyetYBPaKEvw3fBqcARKuB5F-oWIrvkHJpnEC8cyolAJOOfEpEG7HP2E8WCR8 Jun 30 10:07:23.589203 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jun 30 10:07:23.589203 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jun 30 10:07:23.589203 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jun 30 10:07:23.589203 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jun 30 10:07:23.589203 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jun 30 10:07:23.589203 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jun 30 10:07:23.589203 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Id: 2e55dd4580184f158efedbad5dc6e8fb Jun 30 10:07:23.589203 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-AttachVolumeNegativeTest-821277988 Jun 30 10:07:23.589203 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Role: reader,member Jun 30 10:07:23.589203 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Roles: reader,member Jun 30 10:07:23.592489 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:07:23.592489 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-AttachVolumeNegativeTest-821277988 Jun 30 10:07:23.592489 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 2e55dd4580184f158efedbad5dc6e8fb Jun 30 10:07:23.592489 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-821277988 Jun 30 10:07:23.592489 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User: tempest-AttachVolumeNegativeTest-821277988-project Jun 30 10:07:23.592489 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jun 30 10:07:23.592489 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jun 30 10:07:23.592489 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Id: 4e9ad2c4909c49a6b3df8ece333e70b5 Jun 30 10:07:23.592489 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-AttachVolumeNegativeTest-821277988-project Jun 30 10:07:23.592489 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: method: > Jun 30 10:07:23.592489 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: exception: Instance cc0df4f5-54ea-46ae-837b-66e0a4c09443 could not be found. Jun 30 10:07:23.592489 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: action_args: {'id': 'cc0df4f5-54ea-46ae-837b-66e0a4c09443'} Jun 30 10:07:23.594056 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:07:23.594056 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:07:23.594056 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:07:23.594056 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:07:23.594056 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:07:23.594056 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:07:23.594056 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:07:23.594056 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:07:23.594056 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:07:23.594056 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:07:23.594056 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc0df4f5-54ea-46ae-837b-66e0a4c09443 could not be found. Jun 30 10:07:23.594056 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:07:23.594056 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:07:23.594056 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:07:23.594056 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:07:23.594056 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:07:23.594056 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:07:23.594056 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:07:23.594056 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:07:23.594056 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:07:23.595652 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:07:23.595652 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 10:07:23.595652 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 10:07:23.595652 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 10:07:23.595652 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 10:07:23.595652 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:07:23.595652 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:07:23.595652 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:07:23.595652 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:07:23.595652 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc0df4f5-54ea-46ae-837b-66e0a4c09443 could not be found. Jun 30 10:07:23.595652 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:07:23.595652 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:07:23.595652 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:07:23.595652 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:07:23.595652 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:07:23.595652 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:07:23.595652 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:07:23.595652 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:07:23.595652 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc0df4f5-54ea-46ae-837b-66e0a4c09443 could not be found. Jun 30 10:07:23.595652 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:07:23.597561 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-d6d7b0e1-a4b1-47cd-93cb-9ccacf13c89a tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Returning 404 to user: Instance cc0df4f5-54ea-46ae-837b-66e0a4c09443 could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:07:23.597561 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-d6d7b0e1-a4b1-47cd-93cb-9ccacf13c89a tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443" status: 404 len: 111 microversion: 2.1 time: 0.035680 Jun 30 10:07:23.597561 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 427/839] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 10:07:23 2022] DELETE /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:07:23.608144 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-b03034b2-cc0c-4a4a-bd43-b0c5c6678864 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:23.609177 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-b03034b2-cc0c-4a4a-bd43-b0c5c6678864 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: cc0df4f5-54ea-46ae-837b-66e0a4c09443] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:23.616371 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b03034b2-cc0c-4a4a-bd43-b0c5c6678864 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:23.616816 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b03034b2-cc0c-4a4a-bd43-b0c5c6678864 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:23.617573 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b03034b2-cc0c-4a4a-bd43-b0c5c6678864 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:23.618004 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b03034b2-cc0c-4a4a-bd43-b0c5c6678864 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:23.631694 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.wsgi [None req-b03034b2-cc0c-4a4a-bd43-b0c5c6678864 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] HTTP exception thrown: Instance cc0df4f5-54ea-46ae-837b-66e0a4c09443 could not be found. Jun 30 10:07:23.633360 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-b03034b2-cc0c-4a4a-bd43-b0c5c6678864 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Request method failure captured: Jun 30 10:07:23.633360 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: request: GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443 HTTP/1.1 Jun 30 10:07:23.633360 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept: application/json Jun 30 10:07:23.633360 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept-Encoding: identity Jun 30 10:07:23.633360 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Connection: close Jun 30 10:07:23.633360 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Length: 0 Jun 30 10:07:23.633360 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Type: application/json Jun 30 10:07:23.633360 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Host: 10.222.0.16 Jun 30 10:07:23.633360 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Openstack-System-Scope: None Jun 30 10:07:23.633360 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: User-Agent: python-urllib3/1.26.9 Jun 30 10:07:23.633360 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Auth-Token: gAAAAABivXRKWOm8okSqawQyEyFIlPPo5ED3-MkteEmCjIwaTuHRpOC0yz7t-S9pF6F_OHxcNFTgq2ZVvCBW8WpcDzubzrkM7lZXCNWSzcj1P8TCpyHfDpEvKKwyetYBPaKEvw3fBqcARKuB5F-oWIrvkHJpnEC8cyolAJOOfEpEG7HP2E8WCR8 Jun 30 10:07:23.633360 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Id: None Jun 30 10:07:23.633360 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Name: None Jun 30 10:07:23.633360 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Identity-Status: Confirmed Jun 30 10:07:23.633360 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Is-Admin-Project: True Jun 30 10:07:23.633360 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Id: default Jun 30 10:07:23.633360 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Name: Default Jun 30 10:07:23.633360 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Id: 2e55dd4580184f158efedbad5dc6e8fb Jun 30 10:07:23.633360 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Name: tempest-AttachVolumeNegativeTest-821277988 Jun 30 10:07:23.633360 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Role: reader,member Jun 30 10:07:23.633360 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Roles: reader,member Jun 30 10:07:23.634861 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:07:23.634861 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant: tempest-AttachVolumeNegativeTest-821277988 Jun 30 10:07:23.634861 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Id: 2e55dd4580184f158efedbad5dc6e8fb Jun 30 10:07:23.634861 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-821277988 Jun 30 10:07:23.634861 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User: tempest-AttachVolumeNegativeTest-821277988-project Jun 30 10:07:23.634861 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Id: default Jun 30 10:07:23.634861 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Name: Default Jun 30 10:07:23.634861 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Id: 4e9ad2c4909c49a6b3df8ece333e70b5 Jun 30 10:07:23.634861 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Name: tempest-AttachVolumeNegativeTest-821277988-project Jun 30 10:07:23.634861 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: method: > Jun 30 10:07:23.634861 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: exception: Instance cc0df4f5-54ea-46ae-837b-66e0a4c09443 could not be found. Jun 30 10:07:23.634861 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: action_args: {'id': 'cc0df4f5-54ea-46ae-837b-66e0a4c09443'} Jun 30 10:07:23.638275 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:07:23.638275 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:07:23.638275 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:07:23.638275 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:07:23.638275 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:07:23.638275 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:07:23.638275 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:07:23.638275 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:07:23.638275 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:07:23.638275 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:07:23.638275 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc0df4f5-54ea-46ae-837b-66e0a4c09443 could not be found. Jun 30 10:07:23.638275 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:07:23.638275 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:07:23.638275 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:07:23.638275 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:07:23.638275 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:07:23.638275 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:07:23.638275 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:07:23.638275 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:07:23.638275 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:07:23.640099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:07:23.640099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:07:23.640099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:07:23.640099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:07:23.640099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:07:23.640099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:07:23.640099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:07:23.640099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc0df4f5-54ea-46ae-837b-66e0a4c09443 could not be found. Jun 30 10:07:23.640099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:07:23.640099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:07:23.640099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:07:23.640099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:07:23.640099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:07:23.640099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:07:23.640099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:07:23.640099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:07:23.640099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc0df4f5-54ea-46ae-837b-66e0a4c09443 could not be found. Jun 30 10:07:23.640099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:07:23.641486 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-b03034b2-cc0c-4a4a-bd43-b0c5c6678864 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Returning 404 to user: Instance cc0df4f5-54ea-46ae-837b-66e0a4c09443 could not be found. {{(pid=117847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:07:23.641486 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-b03034b2-cc0c-4a4a-bd43-b0c5c6678864 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443" status: 404 len: 111 microversion: 2.1 time: 0.034028 Jun 30 10:07:23.641486 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 413/840] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:07:23 2022] GET /compute/v2.1/servers/cc0df4f5-54ea-46ae-837b-66e0a4c09443 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:07:24.778518 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-190b412b-553d-4c5f-bc91-10213436286d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:24.779081 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-190b412b-553d-4c5f-bc91-10213436286d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 83e934b3-db47-4ab2-a42e-252f5edb6cee] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:24.786113 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-190b412b-553d-4c5f-bc91-10213436286d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:24.786552 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-190b412b-553d-4c5f-bc91-10213436286d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:24.787294 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-190b412b-553d-4c5f-bc91-10213436286d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:24.787712 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-190b412b-553d-4c5f-bc91-10213436286d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:24.801195 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-190b412b-553d-4c5f-bc91-10213436286d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] HTTP exception thrown: Instance 83e934b3-db47-4ab2-a42e-252f5edb6cee could not be found. Jun 30 10:07:24.802694 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-190b412b-553d-4c5f-bc91-10213436286d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Request method failure captured: Jun 30 10:07:24.802694 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: request: DELETE /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee HTTP/1.1 Jun 30 10:07:24.802694 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept: application/json Jun 30 10:07:24.802694 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jun 30 10:07:24.802694 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Connection: close Jun 30 10:07:24.802694 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jun 30 10:07:24.802694 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jun 30 10:07:24.802694 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Host: 10.222.0.16 Jun 30 10:07:24.802694 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jun 30 10:07:24.802694 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jun 30 10:07:24.802694 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABivXRKWOm8okSqawQyEyFIlPPo5ED3-MkteEmCjIwaTuHRpOC0yz7t-S9pF6F_OHxcNFTgq2ZVvCBW8WpcDzubzrkM7lZXCNWSzcj1P8TCpyHfDpEvKKwyetYBPaKEvw3fBqcARKuB5F-oWIrvkHJpnEC8cyolAJOOfEpEG7HP2E8WCR8 Jun 30 10:07:24.802694 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jun 30 10:07:24.802694 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jun 30 10:07:24.802694 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jun 30 10:07:24.802694 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jun 30 10:07:24.802694 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jun 30 10:07:24.802694 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jun 30 10:07:24.802694 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Id: 2e55dd4580184f158efedbad5dc6e8fb Jun 30 10:07:24.802694 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-AttachVolumeNegativeTest-821277988 Jun 30 10:07:24.802694 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Role: reader,member Jun 30 10:07:24.802694 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Roles: reader,member Jun 30 10:07:24.804420 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:07:24.804420 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-AttachVolumeNegativeTest-821277988 Jun 30 10:07:24.804420 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 2e55dd4580184f158efedbad5dc6e8fb Jun 30 10:07:24.804420 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-821277988 Jun 30 10:07:24.804420 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User: tempest-AttachVolumeNegativeTest-821277988-project Jun 30 10:07:24.804420 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jun 30 10:07:24.804420 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jun 30 10:07:24.804420 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Id: 4e9ad2c4909c49a6b3df8ece333e70b5 Jun 30 10:07:24.804420 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-AttachVolumeNegativeTest-821277988-project Jun 30 10:07:24.804420 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: method: > Jun 30 10:07:24.804420 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: exception: Instance 83e934b3-db47-4ab2-a42e-252f5edb6cee could not be found. Jun 30 10:07:24.804420 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: action_args: {'id': '83e934b3-db47-4ab2-a42e-252f5edb6cee'} Jun 30 10:07:24.805459 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:07:24.805459 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:07:24.805459 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:07:24.805459 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:07:24.805459 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:07:24.805459 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:07:24.805459 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:07:24.805459 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:07:24.805459 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:07:24.805459 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:07:24.805459 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83e934b3-db47-4ab2-a42e-252f5edb6cee could not be found. Jun 30 10:07:24.805459 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:07:24.805459 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:07:24.805459 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:07:24.805459 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:07:24.805459 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:07:24.805459 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:07:24.805459 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:07:24.805459 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:07:24.805459 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:07:24.806940 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:07:24.806940 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 10:07:24.806940 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 10:07:24.806940 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 10:07:24.806940 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 10:07:24.806940 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:07:24.806940 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:07:24.806940 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:07:24.806940 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:07:24.806940 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83e934b3-db47-4ab2-a42e-252f5edb6cee could not be found. Jun 30 10:07:24.806940 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:07:24.806940 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:07:24.806940 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:07:24.806940 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:07:24.806940 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:07:24.806940 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:07:24.806940 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:07:24.806940 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:07:24.806940 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83e934b3-db47-4ab2-a42e-252f5edb6cee could not be found. Jun 30 10:07:24.806940 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:07:24.808612 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-190b412b-553d-4c5f-bc91-10213436286d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Returning 404 to user: Instance 83e934b3-db47-4ab2-a42e-252f5edb6cee could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:07:24.808612 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-190b412b-553d-4c5f-bc91-10213436286d tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "DELETE /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee" status: 404 len: 111 microversion: 2.1 time: 0.029407 Jun 30 10:07:24.808612 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 428/841] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 10:07:24 2022] DELETE /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:07:24.813432 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-200e204d-c4cf-4f2c-9fc2-9b73b803db7b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:24.814142 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-200e204d-c4cf-4f2c-9fc2-9b73b803db7b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 83e934b3-db47-4ab2-a42e-252f5edb6cee] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:24.822386 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-200e204d-c4cf-4f2c-9fc2-9b73b803db7b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:24.822834 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-200e204d-c4cf-4f2c-9fc2-9b73b803db7b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:24.823623 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-200e204d-c4cf-4f2c-9fc2-9b73b803db7b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:24.824165 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-200e204d-c4cf-4f2c-9fc2-9b73b803db7b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:24.837919 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.wsgi [None req-200e204d-c4cf-4f2c-9fc2-9b73b803db7b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] HTTP exception thrown: Instance 83e934b3-db47-4ab2-a42e-252f5edb6cee could not be found. Jun 30 10:07:24.839435 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-200e204d-c4cf-4f2c-9fc2-9b73b803db7b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Request method failure captured: Jun 30 10:07:24.839435 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: request: GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee HTTP/1.1 Jun 30 10:07:24.839435 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept: application/json Jun 30 10:07:24.839435 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept-Encoding: identity Jun 30 10:07:24.839435 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Connection: close Jun 30 10:07:24.839435 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Length: 0 Jun 30 10:07:24.839435 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Type: application/json Jun 30 10:07:24.839435 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Host: 10.222.0.16 Jun 30 10:07:24.839435 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Openstack-System-Scope: None Jun 30 10:07:24.839435 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: User-Agent: python-urllib3/1.26.9 Jun 30 10:07:24.839435 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Auth-Token: gAAAAABivXRKWOm8okSqawQyEyFIlPPo5ED3-MkteEmCjIwaTuHRpOC0yz7t-S9pF6F_OHxcNFTgq2ZVvCBW8WpcDzubzrkM7lZXCNWSzcj1P8TCpyHfDpEvKKwyetYBPaKEvw3fBqcARKuB5F-oWIrvkHJpnEC8cyolAJOOfEpEG7HP2E8WCR8 Jun 30 10:07:24.839435 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Id: None Jun 30 10:07:24.839435 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Name: None Jun 30 10:07:24.839435 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Identity-Status: Confirmed Jun 30 10:07:24.839435 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Is-Admin-Project: True Jun 30 10:07:24.839435 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Id: default Jun 30 10:07:24.839435 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Name: Default Jun 30 10:07:24.839435 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Id: 2e55dd4580184f158efedbad5dc6e8fb Jun 30 10:07:24.839435 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Name: tempest-AttachVolumeNegativeTest-821277988 Jun 30 10:07:24.839435 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Role: reader,member Jun 30 10:07:24.839435 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Roles: reader,member Jun 30 10:07:24.841112 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:07:24.841112 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant: tempest-AttachVolumeNegativeTest-821277988 Jun 30 10:07:24.841112 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Id: 2e55dd4580184f158efedbad5dc6e8fb Jun 30 10:07:24.841112 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-821277988 Jun 30 10:07:24.841112 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User: tempest-AttachVolumeNegativeTest-821277988-project Jun 30 10:07:24.841112 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Id: default Jun 30 10:07:24.841112 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Name: Default Jun 30 10:07:24.841112 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Id: 4e9ad2c4909c49a6b3df8ece333e70b5 Jun 30 10:07:24.841112 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Name: tempest-AttachVolumeNegativeTest-821277988-project Jun 30 10:07:24.841112 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: method: > Jun 30 10:07:24.841112 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: exception: Instance 83e934b3-db47-4ab2-a42e-252f5edb6cee could not be found. Jun 30 10:07:24.841112 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: action_args: {'id': '83e934b3-db47-4ab2-a42e-252f5edb6cee'} Jun 30 10:07:24.841908 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:07:24.841908 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:07:24.841908 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:07:24.841908 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:07:24.841908 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:07:24.841908 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:07:24.841908 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:07:24.841908 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:07:24.841908 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:07:24.841908 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:07:24.841908 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83e934b3-db47-4ab2-a42e-252f5edb6cee could not be found. Jun 30 10:07:24.841908 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:07:24.841908 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:07:24.841908 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:07:24.841908 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:07:24.841908 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:07:24.841908 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:07:24.841908 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:07:24.841908 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:07:24.841908 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:07:24.843482 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:07:24.843482 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:07:24.843482 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:07:24.843482 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:07:24.843482 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:07:24.843482 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:07:24.843482 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:07:24.843482 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83e934b3-db47-4ab2-a42e-252f5edb6cee could not be found. Jun 30 10:07:24.843482 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:07:24.843482 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:07:24.843482 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:07:24.843482 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:07:24.843482 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:07:24.843482 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:07:24.843482 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:07:24.843482 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:07:24.843482 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83e934b3-db47-4ab2-a42e-252f5edb6cee could not be found. Jun 30 10:07:24.843482 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:07:24.844759 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-200e204d-c4cf-4f2c-9fc2-9b73b803db7b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Returning 404 to user: Instance 83e934b3-db47-4ab2-a42e-252f5edb6cee could not be found. {{(pid=117847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:07:24.844759 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-200e204d-c4cf-4f2c-9fc2-9b73b803db7b tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee" status: 404 len: 111 microversion: 2.1 time: 0.032068 Jun 30 10:07:24.844759 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 414/842] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:07:24 2022] GET /compute/v2.1/servers/83e934b3-db47-4ab2-a42e-252f5edb6cee => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:07:24.849467 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-a1bd8383-5c63-44e3-8b04-32b6d17c0539 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:24.849975 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-a1bd8383-5c63-44e3-8b04-32b6d17c0539 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 4223d53f-8e20-4343-9119-08cd7dfa6afe] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:24.856321 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a1bd8383-5c63-44e3-8b04-32b6d17c0539 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:24.856769 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a1bd8383-5c63-44e3-8b04-32b6d17c0539 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:24.857523 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a1bd8383-5c63-44e3-8b04-32b6d17c0539 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:24.857955 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a1bd8383-5c63-44e3-8b04-32b6d17c0539 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:24.871820 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-a1bd8383-5c63-44e3-8b04-32b6d17c0539 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] HTTP exception thrown: Instance 4223d53f-8e20-4343-9119-08cd7dfa6afe could not be found. Jun 30 10:07:24.873386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-a1bd8383-5c63-44e3-8b04-32b6d17c0539 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Request method failure captured: Jun 30 10:07:24.873386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: request: DELETE /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe HTTP/1.1 Jun 30 10:07:24.873386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept: application/json Jun 30 10:07:24.873386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jun 30 10:07:24.873386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Connection: close Jun 30 10:07:24.873386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jun 30 10:07:24.873386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jun 30 10:07:24.873386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Host: 10.222.0.16 Jun 30 10:07:24.873386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jun 30 10:07:24.873386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jun 30 10:07:24.873386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABivXRKWOm8okSqawQyEyFIlPPo5ED3-MkteEmCjIwaTuHRpOC0yz7t-S9pF6F_OHxcNFTgq2ZVvCBW8WpcDzubzrkM7lZXCNWSzcj1P8TCpyHfDpEvKKwyetYBPaKEvw3fBqcARKuB5F-oWIrvkHJpnEC8cyolAJOOfEpEG7HP2E8WCR8 Jun 30 10:07:24.873386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jun 30 10:07:24.873386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jun 30 10:07:24.873386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jun 30 10:07:24.873386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jun 30 10:07:24.873386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jun 30 10:07:24.873386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jun 30 10:07:24.873386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Id: 2e55dd4580184f158efedbad5dc6e8fb Jun 30 10:07:24.873386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-AttachVolumeNegativeTest-821277988 Jun 30 10:07:24.873386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Role: reader,member Jun 30 10:07:24.873386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Roles: reader,member Jun 30 10:07:24.875048 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:07:24.875048 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-AttachVolumeNegativeTest-821277988 Jun 30 10:07:24.875048 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 2e55dd4580184f158efedbad5dc6e8fb Jun 30 10:07:24.875048 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-821277988 Jun 30 10:07:24.875048 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User: tempest-AttachVolumeNegativeTest-821277988-project Jun 30 10:07:24.875048 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jun 30 10:07:24.875048 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jun 30 10:07:24.875048 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Id: 4e9ad2c4909c49a6b3df8ece333e70b5 Jun 30 10:07:24.875048 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-AttachVolumeNegativeTest-821277988-project Jun 30 10:07:24.875048 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: method: > Jun 30 10:07:24.875048 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: exception: Instance 4223d53f-8e20-4343-9119-08cd7dfa6afe could not be found. Jun 30 10:07:24.875048 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: action_args: {'id': '4223d53f-8e20-4343-9119-08cd7dfa6afe'} Jun 30 10:07:24.875863 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:07:24.875863 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:07:24.875863 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:07:24.875863 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:07:24.875863 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:07:24.875863 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:07:24.875863 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:07:24.875863 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:07:24.875863 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:07:24.875863 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:07:24.875863 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4223d53f-8e20-4343-9119-08cd7dfa6afe could not be found. Jun 30 10:07:24.875863 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:07:24.875863 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:07:24.875863 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:07:24.875863 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:07:24.875863 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:07:24.875863 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:07:24.875863 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:07:24.875863 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:07:24.875863 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:07:24.877249 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:07:24.877249 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 10:07:24.877249 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 10:07:24.877249 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 10:07:24.877249 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 10:07:24.877249 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:07:24.877249 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:07:24.877249 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:07:24.877249 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:07:24.877249 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4223d53f-8e20-4343-9119-08cd7dfa6afe could not be found. Jun 30 10:07:24.877249 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:07:24.877249 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:07:24.877249 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:07:24.877249 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:07:24.877249 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:07:24.877249 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:07:24.877249 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:07:24.877249 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:07:24.877249 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4223d53f-8e20-4343-9119-08cd7dfa6afe could not be found. Jun 30 10:07:24.877249 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:07:24.878791 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-a1bd8383-5c63-44e3-8b04-32b6d17c0539 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Returning 404 to user: Instance 4223d53f-8e20-4343-9119-08cd7dfa6afe could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:07:24.878791 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-a1bd8383-5c63-44e3-8b04-32b6d17c0539 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe" status: 404 len: 111 microversion: 2.1 time: 0.029805 Jun 30 10:07:24.878791 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 429/843] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 10:07:24 2022] DELETE /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:07:24.883652 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-e1c9008c-ffbe-47db-93b5-760a35dd7751 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:24.884300 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-e1c9008c-ffbe-47db-93b5-760a35dd7751 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 4223d53f-8e20-4343-9119-08cd7dfa6afe] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:24.891097 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e1c9008c-ffbe-47db-93b5-760a35dd7751 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:24.891539 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e1c9008c-ffbe-47db-93b5-760a35dd7751 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:24.892332 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e1c9008c-ffbe-47db-93b5-760a35dd7751 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:24.892763 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e1c9008c-ffbe-47db-93b5-760a35dd7751 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:24.906895 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.wsgi [None req-e1c9008c-ffbe-47db-93b5-760a35dd7751 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] HTTP exception thrown: Instance 4223d53f-8e20-4343-9119-08cd7dfa6afe could not be found. Jun 30 10:07:24.908472 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-e1c9008c-ffbe-47db-93b5-760a35dd7751 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Request method failure captured: Jun 30 10:07:24.908472 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: request: GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe HTTP/1.1 Jun 30 10:07:24.908472 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept: application/json Jun 30 10:07:24.908472 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept-Encoding: identity Jun 30 10:07:24.908472 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Connection: close Jun 30 10:07:24.908472 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Length: 0 Jun 30 10:07:24.908472 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Type: application/json Jun 30 10:07:24.908472 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Host: 10.222.0.16 Jun 30 10:07:24.908472 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Openstack-System-Scope: None Jun 30 10:07:24.908472 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: User-Agent: python-urllib3/1.26.9 Jun 30 10:07:24.908472 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Auth-Token: gAAAAABivXRKWOm8okSqawQyEyFIlPPo5ED3-MkteEmCjIwaTuHRpOC0yz7t-S9pF6F_OHxcNFTgq2ZVvCBW8WpcDzubzrkM7lZXCNWSzcj1P8TCpyHfDpEvKKwyetYBPaKEvw3fBqcARKuB5F-oWIrvkHJpnEC8cyolAJOOfEpEG7HP2E8WCR8 Jun 30 10:07:24.908472 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Id: None Jun 30 10:07:24.908472 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Name: None Jun 30 10:07:24.908472 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Identity-Status: Confirmed Jun 30 10:07:24.908472 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Is-Admin-Project: True Jun 30 10:07:24.908472 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Id: default Jun 30 10:07:24.908472 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Name: Default Jun 30 10:07:24.908472 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Id: 2e55dd4580184f158efedbad5dc6e8fb Jun 30 10:07:24.908472 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Name: tempest-AttachVolumeNegativeTest-821277988 Jun 30 10:07:24.908472 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Role: reader,member Jun 30 10:07:24.908472 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Roles: reader,member Jun 30 10:07:24.910164 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:07:24.910164 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant: tempest-AttachVolumeNegativeTest-821277988 Jun 30 10:07:24.910164 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Id: 2e55dd4580184f158efedbad5dc6e8fb Jun 30 10:07:24.910164 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-821277988 Jun 30 10:07:24.910164 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User: tempest-AttachVolumeNegativeTest-821277988-project Jun 30 10:07:24.910164 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Id: default Jun 30 10:07:24.910164 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Name: Default Jun 30 10:07:24.910164 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Id: 4e9ad2c4909c49a6b3df8ece333e70b5 Jun 30 10:07:24.910164 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Name: tempest-AttachVolumeNegativeTest-821277988-project Jun 30 10:07:24.910164 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: method: > Jun 30 10:07:24.910164 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: exception: Instance 4223d53f-8e20-4343-9119-08cd7dfa6afe could not be found. Jun 30 10:07:24.910164 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: action_args: {'id': '4223d53f-8e20-4343-9119-08cd7dfa6afe'} Jun 30 10:07:24.911426 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:07:24.911426 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:07:24.911426 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:07:24.911426 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:07:24.911426 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:07:24.911426 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:07:24.911426 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:07:24.911426 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:07:24.911426 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:07:24.911426 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:07:24.911426 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4223d53f-8e20-4343-9119-08cd7dfa6afe could not be found. Jun 30 10:07:24.911426 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:07:24.911426 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:07:24.911426 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:07:24.911426 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:07:24.911426 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:07:24.911426 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:07:24.911426 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:07:24.911426 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:07:24.911426 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:07:24.912670 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:07:24.912670 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:07:24.912670 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:07:24.912670 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:07:24.912670 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:07:24.912670 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:07:24.912670 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:07:24.912670 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4223d53f-8e20-4343-9119-08cd7dfa6afe could not be found. Jun 30 10:07:24.912670 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:07:24.912670 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:07:24.912670 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:07:24.912670 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:07:24.912670 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:07:24.912670 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:07:24.912670 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:07:24.912670 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:07:24.912670 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4223d53f-8e20-4343-9119-08cd7dfa6afe could not be found. Jun 30 10:07:24.912670 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:07:24.914565 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-e1c9008c-ffbe-47db-93b5-760a35dd7751 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Returning 404 to user: Instance 4223d53f-8e20-4343-9119-08cd7dfa6afe could not be found. {{(pid=117847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:07:24.914565 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-e1c9008c-ffbe-47db-93b5-760a35dd7751 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe" status: 404 len: 111 microversion: 2.1 time: 0.029997 Jun 30 10:07:24.914565 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 415/844] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:07:24 2022] GET /compute/v2.1/servers/4223d53f-8e20-4343-9119-08cd7dfa6afe => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 30 10:07:26.056609 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-6dd6dd72-53c9-4fa9-b73e-27cc467217c3 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:26.057134 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-6dd6dd72-53c9-4fa9-b73e-27cc467217c3 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 18a19a8d-e121-4f9d-8906-574d6ecce160] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:26.064238 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6dd6dd72-53c9-4fa9-b73e-27cc467217c3 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:26.064676 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6dd6dd72-53c9-4fa9-b73e-27cc467217c3 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:26.065420 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6dd6dd72-53c9-4fa9-b73e-27cc467217c3 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:26.065845 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6dd6dd72-53c9-4fa9-b73e-27cc467217c3 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:26.079535 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-6dd6dd72-53c9-4fa9-b73e-27cc467217c3 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] HTTP exception thrown: Instance 18a19a8d-e121-4f9d-8906-574d6ecce160 could not be found. Jun 30 10:07:26.081117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-6dd6dd72-53c9-4fa9-b73e-27cc467217c3 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Request method failure captured: Jun 30 10:07:26.081117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: request: DELETE /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160 HTTP/1.1 Jun 30 10:07:26.081117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept: application/json Jun 30 10:07:26.081117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jun 30 10:07:26.081117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Connection: close Jun 30 10:07:26.081117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jun 30 10:07:26.081117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jun 30 10:07:26.081117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Host: 10.222.0.16 Jun 30 10:07:26.081117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jun 30 10:07:26.081117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jun 30 10:07:26.081117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABivXRKWOm8okSqawQyEyFIlPPo5ED3-MkteEmCjIwaTuHRpOC0yz7t-S9pF6F_OHxcNFTgq2ZVvCBW8WpcDzubzrkM7lZXCNWSzcj1P8TCpyHfDpEvKKwyetYBPaKEvw3fBqcARKuB5F-oWIrvkHJpnEC8cyolAJOOfEpEG7HP2E8WCR8 Jun 30 10:07:26.081117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jun 30 10:07:26.081117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jun 30 10:07:26.081117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jun 30 10:07:26.081117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jun 30 10:07:26.081117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jun 30 10:07:26.081117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jun 30 10:07:26.081117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Id: 2e55dd4580184f158efedbad5dc6e8fb Jun 30 10:07:26.081117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-AttachVolumeNegativeTest-821277988 Jun 30 10:07:26.081117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Role: reader,member Jun 30 10:07:26.081117 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Roles: reader,member Jun 30 10:07:26.082451 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:07:26.082451 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-AttachVolumeNegativeTest-821277988 Jun 30 10:07:26.082451 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 2e55dd4580184f158efedbad5dc6e8fb Jun 30 10:07:26.082451 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-821277988 Jun 30 10:07:26.082451 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User: tempest-AttachVolumeNegativeTest-821277988-project Jun 30 10:07:26.082451 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jun 30 10:07:26.082451 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jun 30 10:07:26.082451 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Id: 4e9ad2c4909c49a6b3df8ece333e70b5 Jun 30 10:07:26.082451 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-AttachVolumeNegativeTest-821277988-project Jun 30 10:07:26.082451 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: method: > Jun 30 10:07:26.082451 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: exception: Instance 18a19a8d-e121-4f9d-8906-574d6ecce160 could not be found. Jun 30 10:07:26.082451 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: action_args: {'id': '18a19a8d-e121-4f9d-8906-574d6ecce160'} Jun 30 10:07:26.083224 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:07:26.083224 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:07:26.083224 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:07:26.083224 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:07:26.083224 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:07:26.083224 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:07:26.083224 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:07:26.083224 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:07:26.083224 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:07:26.083224 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:07:26.083224 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18a19a8d-e121-4f9d-8906-574d6ecce160 could not be found. Jun 30 10:07:26.083224 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:07:26.083224 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:07:26.083224 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:07:26.083224 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:07:26.083224 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:07:26.083224 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:07:26.083224 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:07:26.083224 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:07:26.083224 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:07:26.084448 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:07:26.084448 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 10:07:26.084448 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 10:07:26.084448 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 10:07:26.084448 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 10:07:26.084448 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:07:26.084448 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:07:26.084448 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:07:26.084448 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:07:26.084448 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18a19a8d-e121-4f9d-8906-574d6ecce160 could not be found. Jun 30 10:07:26.084448 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:07:26.084448 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:07:26.084448 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:07:26.084448 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:07:26.084448 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:07:26.084448 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:07:26.084448 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:07:26.084448 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:07:26.084448 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18a19a8d-e121-4f9d-8906-574d6ecce160 could not be found. Jun 30 10:07:26.084448 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:07:26.085690 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-6dd6dd72-53c9-4fa9-b73e-27cc467217c3 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Returning 404 to user: Instance 18a19a8d-e121-4f9d-8906-574d6ecce160 could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:07:26.085690 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-6dd6dd72-53c9-4fa9-b73e-27cc467217c3 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "DELETE /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160" status: 404 len: 111 microversion: 2.1 time: 0.029843 Jun 30 10:07:26.085690 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 430/845] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 10:07:26 2022] DELETE /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:07:26.093693 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-c8fab6aa-be51-4bb1-a153-fc7737963a07 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:26.094291 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-c8fab6aa-be51-4bb1-a153-fc7737963a07 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] [instance: 18a19a8d-e121-4f9d-8906-574d6ecce160] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:26.100509 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c8fab6aa-be51-4bb1-a153-fc7737963a07 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:26.100945 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c8fab6aa-be51-4bb1-a153-fc7737963a07 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:26.101687 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c8fab6aa-be51-4bb1-a153-fc7737963a07 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:26.102114 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c8fab6aa-be51-4bb1-a153-fc7737963a07 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:26.115975 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.wsgi [None req-c8fab6aa-be51-4bb1-a153-fc7737963a07 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] HTTP exception thrown: Instance 18a19a8d-e121-4f9d-8906-574d6ecce160 could not be found. Jun 30 10:07:26.117649 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-c8fab6aa-be51-4bb1-a153-fc7737963a07 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Request method failure captured: Jun 30 10:07:26.117649 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: request: GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160 HTTP/1.1 Jun 30 10:07:26.117649 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept: application/json Jun 30 10:07:26.117649 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept-Encoding: identity Jun 30 10:07:26.117649 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Connection: close Jun 30 10:07:26.117649 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Length: 0 Jun 30 10:07:26.117649 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Type: application/json Jun 30 10:07:26.117649 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Host: 10.222.0.16 Jun 30 10:07:26.117649 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Openstack-System-Scope: None Jun 30 10:07:26.117649 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: User-Agent: python-urllib3/1.26.9 Jun 30 10:07:26.117649 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Auth-Token: gAAAAABivXRKWOm8okSqawQyEyFIlPPo5ED3-MkteEmCjIwaTuHRpOC0yz7t-S9pF6F_OHxcNFTgq2ZVvCBW8WpcDzubzrkM7lZXCNWSzcj1P8TCpyHfDpEvKKwyetYBPaKEvw3fBqcARKuB5F-oWIrvkHJpnEC8cyolAJOOfEpEG7HP2E8WCR8 Jun 30 10:07:26.117649 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Id: None Jun 30 10:07:26.117649 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Name: None Jun 30 10:07:26.117649 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Identity-Status: Confirmed Jun 30 10:07:26.117649 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Is-Admin-Project: True Jun 30 10:07:26.117649 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Id: default Jun 30 10:07:26.117649 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Name: Default Jun 30 10:07:26.117649 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Id: 2e55dd4580184f158efedbad5dc6e8fb Jun 30 10:07:26.117649 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Name: tempest-AttachVolumeNegativeTest-821277988 Jun 30 10:07:26.117649 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Role: reader,member Jun 30 10:07:26.117649 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Roles: reader,member Jun 30 10:07:26.119060 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2e55dd4580184f158efedbad5dc6e8fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:07:26.119060 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant: tempest-AttachVolumeNegativeTest-821277988 Jun 30 10:07:26.119060 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Id: 2e55dd4580184f158efedbad5dc6e8fb Jun 30 10:07:26.119060 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-821277988 Jun 30 10:07:26.119060 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User: tempest-AttachVolumeNegativeTest-821277988-project Jun 30 10:07:26.119060 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Id: default Jun 30 10:07:26.119060 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Name: Default Jun 30 10:07:26.119060 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Id: 4e9ad2c4909c49a6b3df8ece333e70b5 Jun 30 10:07:26.119060 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Name: tempest-AttachVolumeNegativeTest-821277988-project Jun 30 10:07:26.119060 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: method: > Jun 30 10:07:26.119060 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: exception: Instance 18a19a8d-e121-4f9d-8906-574d6ecce160 could not be found. Jun 30 10:07:26.119060 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: action_args: {'id': '18a19a8d-e121-4f9d-8906-574d6ecce160'} Jun 30 10:07:26.119813 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:07:26.119813 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:07:26.119813 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:07:26.119813 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:07:26.119813 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:07:26.119813 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:07:26.119813 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:07:26.119813 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:07:26.119813 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:07:26.119813 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:07:26.119813 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18a19a8d-e121-4f9d-8906-574d6ecce160 could not be found. Jun 30 10:07:26.119813 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:07:26.119813 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:07:26.119813 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:07:26.119813 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:07:26.119813 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:07:26.119813 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:07:26.119813 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:07:26.119813 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:07:26.119813 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:07:26.121098 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:07:26.121098 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:07:26.121098 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:07:26.121098 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:07:26.121098 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:07:26.121098 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:07:26.121098 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:07:26.121098 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18a19a8d-e121-4f9d-8906-574d6ecce160 could not be found. Jun 30 10:07:26.121098 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:07:26.121098 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:07:26.121098 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:07:26.121098 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:07:26.121098 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:07:26.121098 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:07:26.121098 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:07:26.121098 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:07:26.121098 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18a19a8d-e121-4f9d-8906-574d6ecce160 could not be found. Jun 30 10:07:26.121098 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:07:26.122214 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-c8fab6aa-be51-4bb1-a153-fc7737963a07 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] Returning 404 to user: Instance 18a19a8d-e121-4f9d-8906-574d6ecce160 could not be found. {{(pid=117847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:07:26.122214 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-c8fab6aa-be51-4bb1-a153-fc7737963a07 tempest-AttachVolumeNegativeTest-821277988 tempest-AttachVolumeNegativeTest-821277988-project] 10.222.0.16 "GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160" status: 404 len: 111 microversion: 2.1 time: 0.029485 Jun 30 10:07:26.122214 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 416/846] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:07:26 2022] GET /compute/v2.1/servers/18a19a8d-e121-4f9d-8906-574d6ecce160 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:07:35.278913 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-0a33bac9-136c-4e36-8caf-802e16587c52 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:35.279840 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-0a33bac9-136c-4e36-8caf-802e16587c52 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:35.286435 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0a33bac9-136c-4e36-8caf-802e16587c52 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:35.286899 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0a33bac9-136c-4e36-8caf-802e16587c52 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:35.287651 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0a33bac9-136c-4e36-8caf-802e16587c52 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:35.290975 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0a33bac9-136c-4e36-8caf-802e16587c52 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:35.316376 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-0a33bac9-136c-4e36-8caf-802e16587c52 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685/ips" status: 200 len: 146 microversion: 2.1 time: 0.041710 Jun 30 10:07:35.316954 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 431/847] 10.222.0.16 () {58 vars in 1247 bytes} [Thu Jun 30 10:07:35 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685/ips => generated 146 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:07:38.427585 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-d24911cc-46a6-44bf-bcb3-fc1fe52359a7 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82596e47-0f38-4d76-99e3-61c2ff9909aa"}} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:07:38.428671 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-d24911cc-46a6-44bf-bcb3-fc1fe52359a7 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:38.433070 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:07:38.433724 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:07:38.438455 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d24911cc-46a6-44bf-bcb3-fc1fe52359a7 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:38.438955 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d24911cc-46a6-44bf-bcb3-fc1fe52359a7 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:38.441099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d24911cc-46a6-44bf-bcb3-fc1fe52359a7 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:38.441730 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d24911cc-46a6-44bf-bcb3-fc1fe52359a7 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:38.732026 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-d24911cc-46a6-44bf-bcb3-fc1fe52359a7 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "POST /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.308536 Jun 30 10:07:38.733003 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 417/848] 10.222.0.16 () {60 vars in 1322 bytes} [Thu Jun 30 10:07:38 2022] POST /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685/os-volume_attachments => generated 194 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:07:45.191379 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-9618821e-aa4b-4599-aadd-02cafc32dc5a tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:07:45.198430 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9618821e-aa4b-4599-aadd-02cafc32dc5a tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:45.198875 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9618821e-aa4b-4599-aadd-02cafc32dc5a tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:45.258710 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-9618821e-aa4b-4599-aadd-02cafc32dc5a tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Going to try to stop instance {{(pid=117846) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 30 10:07:45.321127 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-9618821e-aa4b-4599-aadd-02cafc32dc5a tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "POST /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685/action" status: 202 len: 0 microversion: 2.1 time: 0.133012 Jun 30 10:07:45.322111 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 432/849] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Jun 30 10:07:45 2022] POST /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:07:45.336190 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-b58032ba-b288-4a00-b81c-4a76e021c160 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:45.337534 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-b58032ba-b288-4a00-b81c-4a76e021c160 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:45.347374 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b58032ba-b288-4a00-b81c-4a76e021c160 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:45.347989 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b58032ba-b288-4a00-b81c-4a76e021c160 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:45.348987 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b58032ba-b288-4a00-b81c-4a76e021c160 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:45.349482 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b58032ba-b288-4a00-b81c-4a76e021c160 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:45.485468 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-b58032ba-b288-4a00-b81c-4a76e021c160 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:45.493548 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-b58032ba-b288-4a00-b81c-4a76e021c160 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 200 len: 1724 microversion: 2.1 time: 0.166390 Jun 30 10:07:45.494129 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 418/850] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:07:45 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:07:46.511899 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-1471f71a-213e-45c2-8dee-2c32e68f9613 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:46.512605 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-1471f71a-213e-45c2-8dee-2c32e68f9613 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:46.519296 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1471f71a-213e-45c2-8dee-2c32e68f9613 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:46.519771 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1471f71a-213e-45c2-8dee-2c32e68f9613 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:46.520616 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1471f71a-213e-45c2-8dee-2c32e68f9613 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:46.521041 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1471f71a-213e-45c2-8dee-2c32e68f9613 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:46.665999 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-1471f71a-213e-45c2-8dee-2c32e68f9613 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:46.674136 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-1471f71a-213e-45c2-8dee-2c32e68f9613 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 200 len: 1724 microversion: 2.1 time: 0.167164 Jun 30 10:07:46.674699 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 433/851] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:07:46 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:07:47.691004 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-4feddcaa-4a43-4012-a521-8eccf6ca30d8 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:47.691631 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-4feddcaa-4a43-4012-a521-8eccf6ca30d8 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:47.698195 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4feddcaa-4a43-4012-a521-8eccf6ca30d8 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:47.698664 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4feddcaa-4a43-4012-a521-8eccf6ca30d8 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:47.699597 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4feddcaa-4a43-4012-a521-8eccf6ca30d8 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:47.699842 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4feddcaa-4a43-4012-a521-8eccf6ca30d8 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:47.833293 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-4feddcaa-4a43-4012-a521-8eccf6ca30d8 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:47.841555 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-4feddcaa-4a43-4012-a521-8eccf6ca30d8 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 200 len: 1724 microversion: 2.1 time: 0.154303 Jun 30 10:07:47.842249 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 419/852] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:07:47 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:07:48.859139 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-286bd9ca-d698-441c-ace2-4a0f6f0e6988 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:48.859723 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-286bd9ca-d698-441c-ace2-4a0f6f0e6988 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:48.862209 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=22 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:07:48.867633 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-286bd9ca-d698-441c-ace2-4a0f6f0e6988 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:48.868329 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-286bd9ca-d698-441c-ace2-4a0f6f0e6988 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:48.869049 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-286bd9ca-d698-441c-ace2-4a0f6f0e6988 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:48.869498 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-286bd9ca-d698-441c-ace2-4a0f6f0e6988 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:48.872370 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=52,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:07:49.004196 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-286bd9ca-d698-441c-ace2-4a0f6f0e6988 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:49.013466 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-286bd9ca-d698-441c-ace2-4a0f6f0e6988 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 200 len: 1724 microversion: 2.1 time: 0.158313 Jun 30 10:07:49.023160 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 434/853] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:07:48 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:07:49.047593 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-56aed735-9618-4294-acc1-46f2191d07df tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:49.048595 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-56aed735-9618-4294-acc1-46f2191d07df tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:49.055583 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-56aed735-9618-4294-acc1-46f2191d07df tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:49.056068 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-56aed735-9618-4294-acc1-46f2191d07df tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:49.056827 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-56aed735-9618-4294-acc1-46f2191d07df tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:49.057251 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-56aed735-9618-4294-acc1-46f2191d07df tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:49.091850 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-56aed735-9618-4294-acc1-46f2191d07df tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050463 Jun 30 10:07:49.092626 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 420/854] 10.222.0.16 () {60 vars in 1342 bytes} [Thu Jun 30 10:07:49 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:07:49.155017 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-41ffe8f3-fa32-42ac-88a9-64171497fbec tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:49.155552 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-41ffe8f3-fa32-42ac-88a9-64171497fbec tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:49.161796 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-41ffe8f3-fa32-42ac-88a9-64171497fbec tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:49.162238 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-41ffe8f3-fa32-42ac-88a9-64171497fbec tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:49.162993 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-41ffe8f3-fa32-42ac-88a9-64171497fbec tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:49.163476 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-41ffe8f3-fa32-42ac-88a9-64171497fbec tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:49.190283 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-41ffe8f3-fa32-42ac-88a9-64171497fbec tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Going to try to terminate instance {{(pid=117846) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 10:07:49.284647 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-41ffe8f3-fa32-42ac-88a9-64171497fbec tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 204 len: 0 microversion: 2.20 time: 0.133124 Jun 30 10:07:49.285487 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 435/855] 10.222.0.16 () {60 vars in 1279 bytes} [Thu Jun 30 10:07:49 2022] DELETE /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 30 10:07:49.294039 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-df1b74d6-8dde-4da0-9a94-e36ea0ecdc79 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:49.294254 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-df1b74d6-8dde-4da0-9a94-e36ea0ecdc79 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:49.300647 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-df1b74d6-8dde-4da0-9a94-e36ea0ecdc79 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:49.301018 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-df1b74d6-8dde-4da0-9a94-e36ea0ecdc79 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:49.301897 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-df1b74d6-8dde-4da0-9a94-e36ea0ecdc79 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:49.302349 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-df1b74d6-8dde-4da0-9a94-e36ea0ecdc79 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:49.445366 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-df1b74d6-8dde-4da0-9a94-e36ea0ecdc79 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:49.453729 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-df1b74d6-8dde-4da0-9a94-e36ea0ecdc79 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:49.455228 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-df1b74d6-8dde-4da0-9a94-e36ea0ecdc79 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:49.456416 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-df1b74d6-8dde-4da0-9a94-e36ea0ecdc79 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1724 microversion: 2.20 time: 0.166696 Jun 30 10:07:49.456977 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 421/856] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:07:49 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:07:50.036328 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-435c243b-b408-40bc-962b-a39fc5c25d64 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:50.037467 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-435c243b-b408-40bc-962b-a39fc5c25d64 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:50.047711 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-435c243b-b408-40bc-962b-a39fc5c25d64 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:50.048188 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-435c243b-b408-40bc-962b-a39fc5c25d64 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:50.048975 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-435c243b-b408-40bc-962b-a39fc5c25d64 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:50.049408 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-435c243b-b408-40bc-962b-a39fc5c25d64 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:50.188129 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-435c243b-b408-40bc-962b-a39fc5c25d64 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:50.196632 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-435c243b-b408-40bc-962b-a39fc5c25d64 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 200 len: 1724 microversion: 2.1 time: 0.167476 Jun 30 10:07:50.197225 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 436/857] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:07:50 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:07:50.475347 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-87932de5-8d73-48d1-9c39-aa4d63465b6a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:50.476196 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-87932de5-8d73-48d1-9c39-aa4d63465b6a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:50.482904 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-87932de5-8d73-48d1-9c39-aa4d63465b6a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:50.483409 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-87932de5-8d73-48d1-9c39-aa4d63465b6a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:50.484696 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-87932de5-8d73-48d1-9c39-aa4d63465b6a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:50.485241 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-87932de5-8d73-48d1-9c39-aa4d63465b6a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:50.632076 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-87932de5-8d73-48d1-9c39-aa4d63465b6a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:50.640515 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-87932de5-8d73-48d1-9c39-aa4d63465b6a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:50.642006 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-87932de5-8d73-48d1-9c39-aa4d63465b6a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:50.643160 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-87932de5-8d73-48d1-9c39-aa4d63465b6a tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1724 microversion: 2.20 time: 0.171824 Jun 30 10:07:50.643742 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 422/858] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:07:50 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:07:51.214164 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-9ebe2e68-fac6-41b7-a906-8107325cd7ef tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:51.214744 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-9ebe2e68-fac6-41b7-a906-8107325cd7ef tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:51.221987 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9ebe2e68-fac6-41b7-a906-8107325cd7ef tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:51.222433 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9ebe2e68-fac6-41b7-a906-8107325cd7ef tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:51.223200 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9ebe2e68-fac6-41b7-a906-8107325cd7ef tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:51.223635 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9ebe2e68-fac6-41b7-a906-8107325cd7ef tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:51.446459 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-9ebe2e68-fac6-41b7-a906-8107325cd7ef tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:51.455608 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-9ebe2e68-fac6-41b7-a906-8107325cd7ef tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 200 len: 1724 microversion: 2.1 time: 0.245298 Jun 30 10:07:51.456280 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 437/859] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:07:51 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 1724 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:07:51.611575 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [req-9a04e80e-515e-420b-bba4-02f3fa745609 req-eaa33b9f-9678-4fea-b041-10a37123983a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ac05989-c74b-4ae8-90c2-b1c16bd45f87", "name": "network-vif-deleted", "tag": "b21d9a4d-e7dc-4e74-9943-8abf6db35a29"}]} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:07:51.626761 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-9a04e80e-515e-420b-bba4-02f3fa745609 req-eaa33b9f-9678-4fea-b041-10a37123983a service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:51.627591 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-9a04e80e-515e-420b-bba4-02f3fa745609 req-eaa33b9f-9678-4fea-b041-10a37123983a service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:51.644828 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.compute.server_external_events [req-9a04e80e-515e-420b-bba4-02f3fa745609 req-eaa33b9f-9678-4fea-b041-10a37123983a service nova] Creating event network-vif-deleted:b21d9a4d-e7dc-4e74-9943-8abf6db35a29 for instance 4ac05989-c74b-4ae8-90c2-b1c16bd45f87 on hv-cinder-84330 Jun 30 10:07:51.652951 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [req-9a04e80e-515e-420b-bba4-02f3fa745609 req-eaa33b9f-9678-4fea-b041-10a37123983a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044203 Jun 30 10:07:51.663865 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-5f337435-aafa-4f68-a2f1-9f8f393e98bc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:51.665713 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-5f337435-aafa-4f68-a2f1-9f8f393e98bc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:51.668229 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 423/860] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:07:51.673094 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5f337435-aafa-4f68-a2f1-9f8f393e98bc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:51.674039 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5f337435-aafa-4f68-a2f1-9f8f393e98bc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:51.676090 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5f337435-aafa-4f68-a2f1-9f8f393e98bc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:51.676658 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5f337435-aafa-4f68-a2f1-9f8f393e98bc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:51.762594 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-5f337435-aafa-4f68-a2f1-9f8f393e98bc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:51.772303 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-5f337435-aafa-4f68-a2f1-9f8f393e98bc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:51.773873 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-5f337435-aafa-4f68-a2f1-9f8f393e98bc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1614d524d24ce486741b599268995a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a6e910b6b47c09a859ac798bff5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:51.775332 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-5f337435-aafa-4f68-a2f1-9f8f393e98bc tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 200 len: 1657 microversion: 2.20 time: 0.117362 Jun 30 10:07:51.776497 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 438/861] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:07:51 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 1657 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 10:07:52.474599 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-3f013aff-7da2-41ce-b1c6-69cc351663d0 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:52.475294 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-3f013aff-7da2-41ce-b1c6-69cc351663d0 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:52.482291 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3f013aff-7da2-41ce-b1c6-69cc351663d0 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:52.482765 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3f013aff-7da2-41ce-b1c6-69cc351663d0 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:52.483533 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3f013aff-7da2-41ce-b1c6-69cc351663d0 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:52.483995 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3f013aff-7da2-41ce-b1c6-69cc351663d0 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:52.617904 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-3f013aff-7da2-41ce-b1c6-69cc351663d0 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:52.626987 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-3f013aff-7da2-41ce-b1c6-69cc351663d0 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 200 len: 1724 microversion: 2.1 time: 0.156969 Jun 30 10:07:52.627556 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 424/862] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:07:52 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:07:52.794258 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-286d6914-a074-4b9e-bb84-611b715b7981 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:52.794871 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-286d6914-a074-4b9e-bb84-611b715b7981 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:52.802492 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-286d6914-a074-4b9e-bb84-611b715b7981 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:52.802950 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-286d6914-a074-4b9e-bb84-611b715b7981 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:52.803717 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-286d6914-a074-4b9e-bb84-611b715b7981 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:52.804179 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-286d6914-a074-4b9e-bb84-611b715b7981 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:52.819310 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-286d6914-a074-4b9e-bb84-611b715b7981 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] HTTP exception thrown: Instance 4ac05989-c74b-4ae8-90c2-b1c16bd45f87 could not be found. Jun 30 10:07:52.821045 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-286d6914-a074-4b9e-bb84-611b715b7981 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Request method failure captured: Jun 30 10:07:52.821045 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: request: GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 HTTP/1.1 Jun 30 10:07:52.821045 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept: application/json Jun 30 10:07:52.821045 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jun 30 10:07:52.821045 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Connection: close Jun 30 10:07:52.821045 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jun 30 10:07:52.821045 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jun 30 10:07:52.821045 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Host: 10.222.0.16 Jun 30 10:07:52.821045 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jun 30 10:07:52.821045 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jun 30 10:07:52.821045 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABivXROIoqnqppB9zI4SGGx_HRdQgE7Jwf9Q6ABVFO3YF4MJt8iDX9wfl5tmMxCD4aat9DoHOoTi0hqY0qsxR5em_ul168kANlvYR5xftHD2l1FVttzhSs9WOvzMYZWfJBqz4dZiVTw_1W7hycu8WoACIg3wRJ5z1a8aJCL10ePGVb617k Jun 30 10:07:52.821045 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jun 30 10:07:52.821045 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jun 30 10:07:52.821045 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jun 30 10:07:52.821045 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jun 30 10:07:52.821045 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 10:07:52.821045 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jun 30 10:07:52.821045 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jun 30 10:07:52.821045 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Id: f43a6e910b6b47c09a859ac798bff5cd Jun 30 10:07:52.821045 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-869476907 Jun 30 10:07:52.821045 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Role: reader,member Jun 30 10:07:52.821045 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Roles: reader,member Jun 30 10:07:52.822736 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f43a6e910b6b47c09a859ac798bff5cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f43a6e910b6b47c09a859ac798bff5cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f43a6e910b6b47c09a859ac798bff5cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f43a6e910b6b47c09a859ac798bff5cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:07:52.822736 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-AttachVolumeShelveTestJSON-869476907 Jun 30 10:07:52.822736 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Id: f43a6e910b6b47c09a859ac798bff5cd Jun 30 10:07:52.822736 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-869476907 Jun 30 10:07:52.822736 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User: tempest-AttachVolumeShelveTestJSON-869476907-project Jun 30 10:07:52.822736 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jun 30 10:07:52.822736 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jun 30 10:07:52.822736 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Id: 4b1614d524d24ce486741b599268995a Jun 30 10:07:52.822736 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-AttachVolumeShelveTestJSON-869476907-project Jun 30 10:07:52.822736 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: method: > Jun 30 10:07:52.822736 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: exception: Instance 4ac05989-c74b-4ae8-90c2-b1c16bd45f87 could not be found. Jun 30 10:07:52.822736 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: action_args: {'id': '4ac05989-c74b-4ae8-90c2-b1c16bd45f87'} Jun 30 10:07:52.823619 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:07:52.823619 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:07:52.823619 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:07:52.823619 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:07:52.823619 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:07:52.823619 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:07:52.823619 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:07:52.823619 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:07:52.823619 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:07:52.823619 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:07:52.823619 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ac05989-c74b-4ae8-90c2-b1c16bd45f87 could not be found. Jun 30 10:07:52.823619 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:07:52.823619 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:07:52.823619 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:07:52.823619 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:07:52.823619 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:07:52.823619 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:07:52.823619 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:07:52.823619 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:07:52.823619 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:07:52.825342 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:07:52.825342 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:07:52.825342 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:07:52.825342 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:07:52.825342 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:07:52.825342 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:07:52.825342 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:07:52.825342 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ac05989-c74b-4ae8-90c2-b1c16bd45f87 could not be found. Jun 30 10:07:52.825342 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:07:52.825342 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:07:52.825342 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:07:52.825342 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:07:52.825342 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:07:52.825342 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:07:52.825342 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:07:52.825342 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:07:52.825342 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ac05989-c74b-4ae8-90c2-b1c16bd45f87 could not be found. Jun 30 10:07:52.825342 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:07:52.826911 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-286d6914-a074-4b9e-bb84-611b715b7981 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Returning 404 to user: Instance 4ac05989-c74b-4ae8-90c2-b1c16bd45f87 could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:07:52.826911 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-286d6914-a074-4b9e-bb84-611b715b7981 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 404 len: 111 microversion: 2.20 time: 0.032084 Jun 30 10:07:52.826911 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 439/863] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:07:52 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 10:07:52.832538 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-b32f3594-26f6-4f30-8ba8-56c4dc7cdaf0 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '.version_select at 0x7fc22046cd30>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:52.856882 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-b32f3594-26f6-4f30-8ba8-56c4dc7cdaf0 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1770983562" status: 204 len: 0 microversion: 2.20 time: 0.028639 Jun 30 10:07:52.857487 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 425/864] 10.222.0.16 () {60 vars in 1261 bytes} [Thu Jun 30 10:07:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1770983562 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 30 10:07:53.644319 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-0dd98e98-1779-4dd8-b049-c0aca3e36485 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:53.645407 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-0dd98e98-1779-4dd8-b049-c0aca3e36485 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:53.651817 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0dd98e98-1779-4dd8-b049-c0aca3e36485 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:53.652386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0dd98e98-1779-4dd8-b049-c0aca3e36485 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:53.653159 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0dd98e98-1779-4dd8-b049-c0aca3e36485 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:53.653468 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0dd98e98-1779-4dd8-b049-c0aca3e36485 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:53.795000 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-0dd98e98-1779-4dd8-b049-c0aca3e36485 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:53.803827 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-0dd98e98-1779-4dd8-b049-c0aca3e36485 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 200 len: 1724 microversion: 2.1 time: 0.163875 Jun 30 10:07:53.804482 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 440/865] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:07:53 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:07:54.657512 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-1feeeb9c-8594-44dd-95ac-7a486d7acd90 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:54.658432 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-1feeeb9c-8594-44dd-95ac-7a486d7acd90 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:54.665914 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1feeeb9c-8594-44dd-95ac-7a486d7acd90 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:54.666357 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1feeeb9c-8594-44dd-95ac-7a486d7acd90 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:54.667116 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1feeeb9c-8594-44dd-95ac-7a486d7acd90 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:54.667535 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1feeeb9c-8594-44dd-95ac-7a486d7acd90 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:54.681543 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.wsgi [None req-1feeeb9c-8594-44dd-95ac-7a486d7acd90 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] HTTP exception thrown: Instance 4ac05989-c74b-4ae8-90c2-b1c16bd45f87 could not be found. Jun 30 10:07:54.683232 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-1feeeb9c-8594-44dd-95ac-7a486d7acd90 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Request method failure captured: Jun 30 10:07:54.683232 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: request: DELETE /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 HTTP/1.1 Jun 30 10:07:54.683232 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept: application/json Jun 30 10:07:54.683232 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept-Encoding: identity Jun 30 10:07:54.683232 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Connection: close Jun 30 10:07:54.683232 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Length: 0 Jun 30 10:07:54.683232 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Type: application/json Jun 30 10:07:54.683232 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Host: 10.222.0.16 Jun 30 10:07:54.683232 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Openstack-System-Scope: None Jun 30 10:07:54.683232 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: User-Agent: python-urllib3/1.26.9 Jun 30 10:07:54.683232 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Auth-Token: gAAAAABivXROIoqnqppB9zI4SGGx_HRdQgE7Jwf9Q6ABVFO3YF4MJt8iDX9wfl5tmMxCD4aat9DoHOoTi0hqY0qsxR5em_ul168kANlvYR5xftHD2l1FVttzhSs9WOvzMYZWfJBqz4dZiVTw_1W7hycu8WoACIg3wRJ5z1a8aJCL10ePGVb617k Jun 30 10:07:54.683232 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Id: None Jun 30 10:07:54.683232 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Name: None Jun 30 10:07:54.683232 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Identity-Status: Confirmed Jun 30 10:07:54.683232 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Is-Admin-Project: True Jun 30 10:07:54.683232 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 10:07:54.683232 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Id: default Jun 30 10:07:54.683232 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Name: Default Jun 30 10:07:54.683232 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Id: f43a6e910b6b47c09a859ac798bff5cd Jun 30 10:07:54.683232 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-869476907 Jun 30 10:07:54.683232 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Role: reader,member Jun 30 10:07:54.683232 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Roles: reader,member Jun 30 10:07:54.685253 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f43a6e910b6b47c09a859ac798bff5cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f43a6e910b6b47c09a859ac798bff5cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f43a6e910b6b47c09a859ac798bff5cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f43a6e910b6b47c09a859ac798bff5cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:07:54.685253 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant: tempest-AttachVolumeShelveTestJSON-869476907 Jun 30 10:07:54.685253 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Id: f43a6e910b6b47c09a859ac798bff5cd Jun 30 10:07:54.685253 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-869476907 Jun 30 10:07:54.685253 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User: tempest-AttachVolumeShelveTestJSON-869476907-project Jun 30 10:07:54.685253 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Id: default Jun 30 10:07:54.685253 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Name: Default Jun 30 10:07:54.685253 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Id: 4b1614d524d24ce486741b599268995a Jun 30 10:07:54.685253 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Name: tempest-AttachVolumeShelveTestJSON-869476907-project Jun 30 10:07:54.685253 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: method: > Jun 30 10:07:54.685253 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: exception: Instance 4ac05989-c74b-4ae8-90c2-b1c16bd45f87 could not be found. Jun 30 10:07:54.685253 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: action_args: {'id': '4ac05989-c74b-4ae8-90c2-b1c16bd45f87'} Jun 30 10:07:54.689264 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:07:54.689264 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:07:54.689264 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:07:54.689264 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:07:54.689264 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:07:54.689264 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:07:54.689264 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:07:54.689264 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:07:54.689264 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:07:54.689264 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:07:54.689264 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ac05989-c74b-4ae8-90c2-b1c16bd45f87 could not be found. Jun 30 10:07:54.689264 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:07:54.689264 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:07:54.689264 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:07:54.689264 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:07:54.689264 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:07:54.689264 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:07:54.689264 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:07:54.689264 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:07:54.689264 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:07:54.690844 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:07:54.690844 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 10:07:54.690844 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 10:07:54.690844 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 10:07:54.690844 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 10:07:54.690844 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:07:54.690844 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:07:54.690844 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:07:54.690844 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:07:54.690844 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ac05989-c74b-4ae8-90c2-b1c16bd45f87 could not be found. Jun 30 10:07:54.690844 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:07:54.690844 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:07:54.690844 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:07:54.690844 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:07:54.690844 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:07:54.690844 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:07:54.690844 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:07:54.690844 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:07:54.690844 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ac05989-c74b-4ae8-90c2-b1c16bd45f87 could not be found. Jun 30 10:07:54.690844 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:07:54.692457 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-1feeeb9c-8594-44dd-95ac-7a486d7acd90 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Returning 404 to user: Instance 4ac05989-c74b-4ae8-90c2-b1c16bd45f87 could not be found. {{(pid=117847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:07:54.692457 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-1feeeb9c-8594-44dd-95ac-7a486d7acd90 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 404 len: 111 microversion: 2.20 time: 0.031713 Jun 30 10:07:54.692457 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 426/866] 10.222.0.16 () {60 vars in 1279 bytes} [Thu Jun 30 10:07:54 2022] DELETE /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 10:07:54.693874 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-7b7363f2-a78a-4f49-ac91-7315e5d4275d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:54.694469 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-7b7363f2-a78a-4f49-ac91-7315e5d4275d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 4ac05989-c74b-4ae8-90c2-b1c16bd45f87] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:54.700604 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7b7363f2-a78a-4f49-ac91-7315e5d4275d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:54.701040 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7b7363f2-a78a-4f49-ac91-7315e5d4275d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:54.701779 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7b7363f2-a78a-4f49-ac91-7315e5d4275d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:54.702221 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7b7363f2-a78a-4f49-ac91-7315e5d4275d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:54.716097 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-7b7363f2-a78a-4f49-ac91-7315e5d4275d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] HTTP exception thrown: Instance 4ac05989-c74b-4ae8-90c2-b1c16bd45f87 could not be found. Jun 30 10:07:54.717718 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-7b7363f2-a78a-4f49-ac91-7315e5d4275d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Request method failure captured: Jun 30 10:07:54.717718 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: request: GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 HTTP/1.1 Jun 30 10:07:54.717718 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept: application/json Jun 30 10:07:54.717718 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jun 30 10:07:54.717718 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Connection: close Jun 30 10:07:54.717718 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jun 30 10:07:54.717718 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jun 30 10:07:54.717718 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Host: 10.222.0.16 Jun 30 10:07:54.717718 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jun 30 10:07:54.717718 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jun 30 10:07:54.717718 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABivXROIoqnqppB9zI4SGGx_HRdQgE7Jwf9Q6ABVFO3YF4MJt8iDX9wfl5tmMxCD4aat9DoHOoTi0hqY0qsxR5em_ul168kANlvYR5xftHD2l1FVttzhSs9WOvzMYZWfJBqz4dZiVTw_1W7hycu8WoACIg3wRJ5z1a8aJCL10ePGVb617k Jun 30 10:07:54.717718 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jun 30 10:07:54.717718 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jun 30 10:07:54.717718 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jun 30 10:07:54.717718 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jun 30 10:07:54.717718 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 10:07:54.717718 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jun 30 10:07:54.717718 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jun 30 10:07:54.717718 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Id: f43a6e910b6b47c09a859ac798bff5cd Jun 30 10:07:54.717718 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-869476907 Jun 30 10:07:54.717718 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Role: reader,member Jun 30 10:07:54.717718 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Roles: reader,member Jun 30 10:07:54.719610 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f43a6e910b6b47c09a859ac798bff5cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f43a6e910b6b47c09a859ac798bff5cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f43a6e910b6b47c09a859ac798bff5cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f43a6e910b6b47c09a859ac798bff5cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:07:54.719610 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-AttachVolumeShelveTestJSON-869476907 Jun 30 10:07:54.719610 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Id: f43a6e910b6b47c09a859ac798bff5cd Jun 30 10:07:54.719610 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-869476907 Jun 30 10:07:54.719610 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User: tempest-AttachVolumeShelveTestJSON-869476907-project Jun 30 10:07:54.719610 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jun 30 10:07:54.719610 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jun 30 10:07:54.719610 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Id: 4b1614d524d24ce486741b599268995a Jun 30 10:07:54.719610 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-AttachVolumeShelveTestJSON-869476907-project Jun 30 10:07:54.719610 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: method: > Jun 30 10:07:54.719610 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: exception: Instance 4ac05989-c74b-4ae8-90c2-b1c16bd45f87 could not be found. Jun 30 10:07:54.719610 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: action_args: {'id': '4ac05989-c74b-4ae8-90c2-b1c16bd45f87'} Jun 30 10:07:54.720558 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:07:54.720558 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:07:54.720558 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:07:54.720558 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:07:54.720558 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:07:54.720558 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:07:54.720558 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:07:54.720558 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:07:54.720558 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:07:54.720558 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:07:54.720558 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ac05989-c74b-4ae8-90c2-b1c16bd45f87 could not be found. Jun 30 10:07:54.720558 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:07:54.720558 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:07:54.720558 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:07:54.720558 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:07:54.720558 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:07:54.720558 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:07:54.720558 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:07:54.720558 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:07:54.720558 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:07:54.722100 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:07:54.722100 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:07:54.722100 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:07:54.722100 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:07:54.722100 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:07:54.722100 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:07:54.722100 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:07:54.722100 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ac05989-c74b-4ae8-90c2-b1c16bd45f87 could not be found. Jun 30 10:07:54.722100 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:07:54.722100 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:07:54.722100 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:07:54.722100 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:07:54.722100 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:07:54.722100 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:07:54.722100 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:07:54.722100 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:07:54.722100 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ac05989-c74b-4ae8-90c2-b1c16bd45f87 could not be found. Jun 30 10:07:54.722100 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:07:54.723366 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-7b7363f2-a78a-4f49-ac91-7315e5d4275d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Returning 404 to user: Instance 4ac05989-c74b-4ae8-90c2-b1c16bd45f87 could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:07:54.723366 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-7b7363f2-a78a-4f49-ac91-7315e5d4275d tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87" status: 404 len: 111 microversion: 2.20 time: 0.029294 Jun 30 10:07:54.723366 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 441/867] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:07:54 2022] GET /compute/v2.1/servers/4ac05989-c74b-4ae8-90c2-b1c16bd45f87 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 10:07:54.822811 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-41ed6965-6285-45ee-a72a-2aa3a538f7d1 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:54.823895 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-41ed6965-6285-45ee-a72a-2aa3a538f7d1 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:54.831544 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-41ed6965-6285-45ee-a72a-2aa3a538f7d1 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:54.832011 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-41ed6965-6285-45ee-a72a-2aa3a538f7d1 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:54.832800 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-41ed6965-6285-45ee-a72a-2aa3a538f7d1 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:54.833229 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-41ed6965-6285-45ee-a72a-2aa3a538f7d1 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:54.977058 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-41ed6965-6285-45ee-a72a-2aa3a538f7d1 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:54.986148 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-41ed6965-6285-45ee-a72a-2aa3a538f7d1 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 200 len: 1724 microversion: 2.1 time: 0.167357 Jun 30 10:07:54.986734 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 427/868] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:07:54 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:07:55.864877 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-b3b19b65-4cad-4c4d-8ba1-b33badf1ae7f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:55.865396 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-b3b19b65-4cad-4c4d-8ba1-b33badf1ae7f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:55.871854 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b3b19b65-4cad-4c4d-8ba1-b33badf1ae7f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:55.872427 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b3b19b65-4cad-4c4d-8ba1-b33badf1ae7f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:55.873177 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b3b19b65-4cad-4c4d-8ba1-b33badf1ae7f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:55.873595 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b3b19b65-4cad-4c4d-8ba1-b33badf1ae7f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:55.887049 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-b3b19b65-4cad-4c4d-8ba1-b33badf1ae7f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] HTTP exception thrown: Instance 8c15c69f-e851-41aa-9f31-0e897b2f302d could not be found. Jun 30 10:07:55.888628 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-b3b19b65-4cad-4c4d-8ba1-b33badf1ae7f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Request method failure captured: Jun 30 10:07:55.888628 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: request: DELETE /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d HTTP/1.1 Jun 30 10:07:55.888628 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept: application/json Jun 30 10:07:55.888628 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jun 30 10:07:55.888628 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Connection: close Jun 30 10:07:55.888628 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jun 30 10:07:55.888628 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jun 30 10:07:55.888628 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Host: 10.222.0.16 Jun 30 10:07:55.888628 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jun 30 10:07:55.888628 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jun 30 10:07:55.888628 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABivXROIoqnqppB9zI4SGGx_HRdQgE7Jwf9Q6ABVFO3YF4MJt8iDX9wfl5tmMxCD4aat9DoHOoTi0hqY0qsxR5em_ul168kANlvYR5xftHD2l1FVttzhSs9WOvzMYZWfJBqz4dZiVTw_1W7hycu8WoACIg3wRJ5z1a8aJCL10ePGVb617k Jun 30 10:07:55.888628 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jun 30 10:07:55.888628 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jun 30 10:07:55.888628 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jun 30 10:07:55.888628 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jun 30 10:07:55.888628 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 10:07:55.888628 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jun 30 10:07:55.888628 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jun 30 10:07:55.888628 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Id: f43a6e910b6b47c09a859ac798bff5cd Jun 30 10:07:55.888628 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-869476907 Jun 30 10:07:55.888628 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Role: reader,member Jun 30 10:07:55.888628 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Roles: reader,member Jun 30 10:07:55.890207 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f43a6e910b6b47c09a859ac798bff5cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f43a6e910b6b47c09a859ac798bff5cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f43a6e910b6b47c09a859ac798bff5cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f43a6e910b6b47c09a859ac798bff5cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:07:55.890207 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-AttachVolumeShelveTestJSON-869476907 Jun 30 10:07:55.890207 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Id: f43a6e910b6b47c09a859ac798bff5cd Jun 30 10:07:55.890207 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-869476907 Jun 30 10:07:55.890207 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User: tempest-AttachVolumeShelveTestJSON-869476907-project Jun 30 10:07:55.890207 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jun 30 10:07:55.890207 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jun 30 10:07:55.890207 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Id: 4b1614d524d24ce486741b599268995a Jun 30 10:07:55.890207 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-AttachVolumeShelveTestJSON-869476907-project Jun 30 10:07:55.890207 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: method: > Jun 30 10:07:55.890207 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: exception: Instance 8c15c69f-e851-41aa-9f31-0e897b2f302d could not be found. Jun 30 10:07:55.890207 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: action_args: {'id': '8c15c69f-e851-41aa-9f31-0e897b2f302d'} Jun 30 10:07:55.891651 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:07:55.891651 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:07:55.891651 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:07:55.891651 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:07:55.891651 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:07:55.891651 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:07:55.891651 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:07:55.891651 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:07:55.891651 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:07:55.891651 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:07:55.891651 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c15c69f-e851-41aa-9f31-0e897b2f302d could not be found. Jun 30 10:07:55.891651 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:07:55.891651 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:07:55.891651 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:07:55.891651 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:07:55.891651 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:07:55.891651 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:07:55.891651 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:07:55.891651 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:07:55.891651 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:07:55.893082 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:07:55.893082 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 10:07:55.893082 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 10:07:55.893082 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 10:07:55.893082 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 10:07:55.893082 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:07:55.893082 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:07:55.893082 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:07:55.893082 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:07:55.893082 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c15c69f-e851-41aa-9f31-0e897b2f302d could not be found. Jun 30 10:07:55.893082 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:07:55.893082 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:07:55.893082 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:07:55.893082 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:07:55.893082 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:07:55.893082 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:07:55.893082 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:07:55.893082 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:07:55.893082 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c15c69f-e851-41aa-9f31-0e897b2f302d could not be found. Jun 30 10:07:55.893082 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:07:55.894519 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-b3b19b65-4cad-4c4d-8ba1-b33badf1ae7f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Returning 404 to user: Instance 8c15c69f-e851-41aa-9f31-0e897b2f302d could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:07:55.894519 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-b3b19b65-4cad-4c4d-8ba1-b33badf1ae7f tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 404 len: 111 microversion: 2.20 time: 0.029379 Jun 30 10:07:55.894519 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 442/869] 10.222.0.16 () {60 vars in 1279 bytes} [Thu Jun 30 10:07:55 2022] DELETE /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 10:07:55.898532 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-33a11dab-11aa-4fd5-bf07-8a41c7a82711 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:55.899122 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-33a11dab-11aa-4fd5-bf07-8a41c7a82711 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] [instance: 8c15c69f-e851-41aa-9f31-0e897b2f302d] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:55.905792 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-33a11dab-11aa-4fd5-bf07-8a41c7a82711 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:55.906474 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-33a11dab-11aa-4fd5-bf07-8a41c7a82711 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:55.907013 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-33a11dab-11aa-4fd5-bf07-8a41c7a82711 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:55.907437 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-33a11dab-11aa-4fd5-bf07-8a41c7a82711 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:55.920734 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.wsgi [None req-33a11dab-11aa-4fd5-bf07-8a41c7a82711 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] HTTP exception thrown: Instance 8c15c69f-e851-41aa-9f31-0e897b2f302d could not be found. Jun 30 10:07:55.922263 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-33a11dab-11aa-4fd5-bf07-8a41c7a82711 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Request method failure captured: Jun 30 10:07:55.922263 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: request: GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d HTTP/1.1 Jun 30 10:07:55.922263 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept: application/json Jun 30 10:07:55.922263 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept-Encoding: identity Jun 30 10:07:55.922263 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Connection: close Jun 30 10:07:55.922263 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Length: 0 Jun 30 10:07:55.922263 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Type: application/json Jun 30 10:07:55.922263 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Host: 10.222.0.16 Jun 30 10:07:55.922263 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Openstack-System-Scope: None Jun 30 10:07:55.922263 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: User-Agent: python-urllib3/1.26.9 Jun 30 10:07:55.922263 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Auth-Token: gAAAAABivXROIoqnqppB9zI4SGGx_HRdQgE7Jwf9Q6ABVFO3YF4MJt8iDX9wfl5tmMxCD4aat9DoHOoTi0hqY0qsxR5em_ul168kANlvYR5xftHD2l1FVttzhSs9WOvzMYZWfJBqz4dZiVTw_1W7hycu8WoACIg3wRJ5z1a8aJCL10ePGVb617k Jun 30 10:07:55.922263 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Id: None Jun 30 10:07:55.922263 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Name: None Jun 30 10:07:55.922263 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Identity-Status: Confirmed Jun 30 10:07:55.922263 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Is-Admin-Project: True Jun 30 10:07:55.922263 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 10:07:55.922263 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Id: default Jun 30 10:07:55.922263 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Name: Default Jun 30 10:07:55.922263 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Id: f43a6e910b6b47c09a859ac798bff5cd Jun 30 10:07:55.922263 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-869476907 Jun 30 10:07:55.922263 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Role: reader,member Jun 30 10:07:55.922263 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Roles: reader,member Jun 30 10:07:55.923998 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f43a6e910b6b47c09a859ac798bff5cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f43a6e910b6b47c09a859ac798bff5cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f43a6e910b6b47c09a859ac798bff5cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f43a6e910b6b47c09a859ac798bff5cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:07:55.923998 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant: tempest-AttachVolumeShelveTestJSON-869476907 Jun 30 10:07:55.923998 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Id: f43a6e910b6b47c09a859ac798bff5cd Jun 30 10:07:55.923998 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-869476907 Jun 30 10:07:55.923998 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User: tempest-AttachVolumeShelveTestJSON-869476907-project Jun 30 10:07:55.923998 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Id: default Jun 30 10:07:55.923998 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Name: Default Jun 30 10:07:55.923998 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Id: 4b1614d524d24ce486741b599268995a Jun 30 10:07:55.923998 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Name: tempest-AttachVolumeShelveTestJSON-869476907-project Jun 30 10:07:55.923998 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: method: > Jun 30 10:07:55.923998 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: exception: Instance 8c15c69f-e851-41aa-9f31-0e897b2f302d could not be found. Jun 30 10:07:55.923998 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: action_args: {'id': '8c15c69f-e851-41aa-9f31-0e897b2f302d'} Jun 30 10:07:55.924969 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:07:55.924969 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:07:55.924969 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:07:55.924969 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:07:55.924969 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:07:55.924969 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:07:55.924969 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:07:55.924969 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:07:55.924969 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:07:55.924969 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:07:55.924969 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c15c69f-e851-41aa-9f31-0e897b2f302d could not be found. Jun 30 10:07:55.924969 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:07:55.924969 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:07:55.924969 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:07:55.924969 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:07:55.924969 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:07:55.924969 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:07:55.924969 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:07:55.924969 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:07:55.924969 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:07:55.926161 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:07:55.926161 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:07:55.926161 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:07:55.926161 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:07:55.926161 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:07:55.926161 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:07:55.926161 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:07:55.926161 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c15c69f-e851-41aa-9f31-0e897b2f302d could not be found. Jun 30 10:07:55.926161 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:07:55.926161 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:07:55.926161 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:07:55.926161 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:07:55.926161 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:07:55.926161 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:07:55.926161 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:07:55.926161 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:07:55.926161 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c15c69f-e851-41aa-9f31-0e897b2f302d could not be found. Jun 30 10:07:55.926161 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:07:55.927354 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-33a11dab-11aa-4fd5-bf07-8a41c7a82711 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] Returning 404 to user: Instance 8c15c69f-e851-41aa-9f31-0e897b2f302d could not be found. {{(pid=117847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:07:55.927354 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-33a11dab-11aa-4fd5-bf07-8a41c7a82711 tempest-AttachVolumeShelveTestJSON-869476907 tempest-AttachVolumeShelveTestJSON-869476907-project] 10.222.0.16 "GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d" status: 404 len: 111 microversion: 2.20 time: 0.028906 Jun 30 10:07:55.927354 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 428/870] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 10:07:55 2022] GET /compute/v2.1/servers/8c15c69f-e851-41aa-9f31-0e897b2f302d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 10:07:56.012529 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-5ec46e97-46e9-449f-9d9d-9953d53b63c5 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:56.013191 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-5ec46e97-46e9-449f-9d9d-9953d53b63c5 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:56.021857 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5ec46e97-46e9-449f-9d9d-9953d53b63c5 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:56.022309 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5ec46e97-46e9-449f-9d9d-9953d53b63c5 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:56.023672 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5ec46e97-46e9-449f-9d9d-9953d53b63c5 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:56.024181 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5ec46e97-46e9-449f-9d9d-9953d53b63c5 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:56.253764 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-5ec46e97-46e9-449f-9d9d-9953d53b63c5 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:56.262177 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-5ec46e97-46e9-449f-9d9d-9953d53b63c5 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 200 len: 1701 microversion: 2.1 time: 0.255214 Jun 30 10:07:56.262744 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 443/871] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:07:56 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 1701 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:07:56.278680 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-b762fb75-78d6-4d5d-bc4c-85a523c1f8ec tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:07:56.285251 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b762fb75-78d6-4d5d-bc4c-85a523c1f8ec tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:56.285702 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b762fb75-78d6-4d5d-bc4c-85a523c1f8ec tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:56.346929 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-b762fb75-78d6-4d5d-bc4c-85a523c1f8ec tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Going to try to start instance {{(pid=117847) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 30 10:07:56.392769 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-b762fb75-78d6-4d5d-bc4c-85a523c1f8ec tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "POST /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685/action" status: 202 len: 0 microversion: 2.1 time: 0.117951 Jun 30 10:07:56.393868 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 429/872] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Jun 30 10:07:56 2022] POST /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:07:56.402409 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-1ed051fd-6735-41d3-9cd8-e9cc652429fa tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:56.403266 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-1ed051fd-6735-41d3-9cd8-e9cc652429fa tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:56.409741 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1ed051fd-6735-41d3-9cd8-e9cc652429fa tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:56.410434 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1ed051fd-6735-41d3-9cd8-e9cc652429fa tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:56.411209 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1ed051fd-6735-41d3-9cd8-e9cc652429fa tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:56.411651 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1ed051fd-6735-41d3-9cd8-e9cc652429fa tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:56.696415 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-1ed051fd-6735-41d3-9cd8-e9cc652429fa tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:56.711418 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-1ed051fd-6735-41d3-9cd8-e9cc652429fa tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 200 len: 1710 microversion: 2.1 time: 0.312781 Jun 30 10:07:56.712752 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 444/873] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:07:56 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 1710 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:07:57.730194 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-2e6c14ce-d30c-4021-ad69-e5a9b0ace668 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:57.730925 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-2e6c14ce-d30c-4021-ad69-e5a9b0ace668 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:57.738308 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2e6c14ce-d30c-4021-ad69-e5a9b0ace668 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:57.738833 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2e6c14ce-d30c-4021-ad69-e5a9b0ace668 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:57.739671 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2e6c14ce-d30c-4021-ad69-e5a9b0ace668 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:57.740779 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2e6c14ce-d30c-4021-ad69-e5a9b0ace668 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:57.979416 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-2e6c14ce-d30c-4021-ad69-e5a9b0ace668 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:57.990092 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-2e6c14ce-d30c-4021-ad69-e5a9b0ace668 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 200 len: 1710 microversion: 2.1 time: 0.264306 Jun 30 10:07:57.990720 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 430/874] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:07:57 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 1710 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:07:59.006961 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-7ee98644-0be8-42f7-afd8-8718e21256fe tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:07:59.007532 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-7ee98644-0be8-42f7-afd8-8718e21256fe tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:07:59.014718 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7ee98644-0be8-42f7-afd8-8718e21256fe tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:59.015163 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7ee98644-0be8-42f7-afd8-8718e21256fe tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:59.016375 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7ee98644-0be8-42f7-afd8-8718e21256fe tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:07:59.016812 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7ee98644-0be8-42f7-afd8-8718e21256fe tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:07:59.258835 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7ee98644-0be8-42f7-afd8-8718e21256fe tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:07:59.267400 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-7ee98644-0be8-42f7-afd8-8718e21256fe tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 200 len: 1714 microversion: 2.1 time: 0.264396 Jun 30 10:07:59.268150 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 445/875] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:07:59 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 1714 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:02.542672 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-00b2c5a3-2184-4a77-9050-6f9d73657e4c tempest-VolumesTestJSON-12351089 tempest-VolumesTestJSON-12351089-project] Calling method '.version_select at 0x7fc224bc2430>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:02.591597 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-00b2c5a3-2184-4a77-9050-6f9d73657e4c tempest-VolumesTestJSON-12351089 tempest-VolumesTestJSON-12351089-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/f5b54958-80b0-448d-99ba-27f56c13c8f8" status: 200 len: 350 microversion: 2.1 time: 0.054875 Jun 30 10:08:02.592199 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 431/876] 10.222.0.16 () {58 vars in 1244 bytes} [Thu Jun 30 10:08:02 2022] GET /compute/v2.1/os-volumes/f5b54958-80b0-448d-99ba-27f56c13c8f8 => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:08:03.926924 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e6452641-67cb-4ef4-8636-bab4b320366b tempest-VolumesTestJSON-12351089 tempest-VolumesTestJSON-12351089-project] Calling method '.version_select at 0x7fc220388940>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:03.976396 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-e6452641-67cb-4ef4-8636-bab4b320366b tempest-VolumesTestJSON-12351089 tempest-VolumesTestJSON-12351089-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/382cc501-5930-4b9f-80c9-c66706b69b22" status: 200 len: 351 microversion: 2.1 time: 0.053341 Jun 30 10:08:03.976962 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 446/877] 10.222.0.16 () {58 vars in 1244 bytes} [Thu Jun 30 10:08:03 2022] GET /compute/v2.1/os-volumes/382cc501-5930-4b9f-80c9-c66706b69b22 => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:08:05.314938 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-f074f4b9-a448-439c-98bd-7e81a89749c8 tempest-VolumesTestJSON-12351089 tempest-VolumesTestJSON-12351089-project] Calling method '.version_select at 0x7fc220502af0>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:05.364778 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-f074f4b9-a448-439c-98bd-7e81a89749c8 tempest-VolumesTestJSON-12351089 tempest-VolumesTestJSON-12351089-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/482da234-1099-4136-a619-c5868e23245b" status: 200 len: 351 microversion: 2.1 time: 0.053600 Jun 30 10:08:05.365333 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 432/878] 10.222.0.16 () {58 vars in 1244 bytes} [Thu Jun 30 10:08:05 2022] GET /compute/v2.1/os-volumes/482da234-1099-4136-a619-c5868e23245b => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:08:05.377416 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ae9499ff-bf2d-42e9-82b1-d98bad63bed6 tempest-VolumesTestJSON-12351089 tempest-VolumesTestJSON-12351089-project] Calling method '.version_select at 0x7fc2202731f0>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:05.460011 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ae9499ff-bf2d-42e9-82b1-d98bad63bed6 tempest-VolumesTestJSON-12351089 tempest-VolumesTestJSON-12351089-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.086884 Jun 30 10:08:05.465559 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 447/879] 10.222.0.16 () {58 vars in 1133 bytes} [Thu Jun 30 10:08:05 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:05.473492 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-4e26cad2-5c70-46b8-a06c-4dea3825faa3 tempest-VolumesTestJSON-12351089 tempest-VolumesTestJSON-12351089-project] Calling method '.version_select at 0x7fc224bafa60>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:05.555326 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-4e26cad2-5c70-46b8-a06c-4dea3825faa3 tempest-VolumesTestJSON-12351089 tempest-VolumesTestJSON-12351089-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.085969 Jun 30 10:08:05.556004 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 433/880] 10.222.0.16 () {58 vars in 1148 bytes} [Thu Jun 30 10:08:05 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:08:05.568153 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-b74f1ae6-6f64-4018-8df5-58e2bbb8860c tempest-VolumesTestJSON-12351089 tempest-VolumesTestJSON-12351089-project] Calling method '.version_select at 0x7fc22021f670>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:05.650152 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-b74f1ae6-6f64-4018-8df5-58e2bbb8860c tempest-VolumesTestJSON-12351089 tempest-VolumesTestJSON-12351089-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.085724 Jun 30 10:08:05.651081 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 448/881] 10.222.0.16 () {58 vars in 1133 bytes} [Thu Jun 30 10:08:05 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:05.662178 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-abbf179a-dbeb-4887-ae3f-b3577615180a tempest-VolumesTestJSON-12351089 tempest-VolumesTestJSON-12351089-project] Calling method '.version_select at 0x7fc224c55820>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:05.753863 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-abbf179a-dbeb-4887-ae3f-b3577615180a tempest-VolumesTestJSON-12351089 tempest-VolumesTestJSON-12351089-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.094953 Jun 30 10:08:05.754924 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 434/882] 10.222.0.16 () {58 vars in 1166 bytes} [Thu Jun 30 10:08:05 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:08:05.771142 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-81c4ba77-11c7-4305-a06e-ae1cd579de89 tempest-VolumesTestJSON-12351089 tempest-VolumesTestJSON-12351089-project] Calling method '.version_select at 0x7fc22021fe50>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:05.853068 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-81c4ba77-11c7-4305-a06e-ae1cd579de89 tempest-VolumesTestJSON-12351089 tempest-VolumesTestJSON-12351089-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.086249 Jun 30 10:08:05.853636 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 449/883] 10.222.0.16 () {58 vars in 1169 bytes} [Thu Jun 30 10:08:05 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:08:05.865781 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-c9296554-3d67-43c6-b958-42c6ef5b2532 tempest-VolumesTestJSON-12351089 tempest-VolumesTestJSON-12351089-project] Calling method '.version_select at 0x7fc224bc20d0>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:05.948714 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-c9296554-3d67-43c6-b958-42c6ef5b2532 tempest-VolumesTestJSON-12351089 tempest-VolumesTestJSON-12351089-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.086660 Jun 30 10:08:05.949281 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 435/884] 10.222.0.16 () {58 vars in 1154 bytes} [Thu Jun 30 10:08:05 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:05.961008 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-29283a80-60a8-4e4b-acb9-a59c1883835b tempest-VolumesTestJSON-12351089 tempest-VolumesTestJSON-12351089-project] Calling method '.version_select at 0x7fc2201fa5e0>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:06.048227 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-29283a80-60a8-4e4b-acb9-a59c1883835b tempest-VolumesTestJSON-12351089 tempest-VolumesTestJSON-12351089-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.091159 Jun 30 10:08:06.048821 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 450/885] 10.222.0.16 () {58 vars in 1187 bytes} [Thu Jun 30 10:08:05 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:08:06.061046 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-3232ef6d-3751-4512-af2d-cb1585200628 tempest-VolumesTestJSON-12351089 tempest-VolumesTestJSON-12351089-project] Calling method '.version_select at 0x7fc224ba3c10>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:06.146841 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-3232ef6d-3751-4512-af2d-cb1585200628 tempest-VolumesTestJSON-12351089 tempest-VolumesTestJSON-12351089-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.089960 Jun 30 10:08:06.147421 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 436/886] 10.222.0.16 () {58 vars in 1154 bytes} [Thu Jun 30 10:08:06 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:33.158750 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:33.160152 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:33.167364 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-832b1b8e-ead7-4174-bb7d-819a2f35e13f tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:33.168222 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-832b1b8e-ead7-4174-bb7d-819a2f35e13f tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 1802a0eb-4ac0-4939-b119-af84e90c5859] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:08:33.178906 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-832b1b8e-ead7-4174-bb7d-819a2f35e13f tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:33.179481 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-832b1b8e-ead7-4174-bb7d-819a2f35e13f tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:33.180274 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-832b1b8e-ead7-4174-bb7d-819a2f35e13f tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:33.180704 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-832b1b8e-ead7-4174-bb7d-819a2f35e13f tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:33.206834 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-832b1b8e-ead7-4174-bb7d-819a2f35e13f tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 1802a0eb-4ac0-4939-b119-af84e90c5859] Going to try to terminate instance {{(pid=117846) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 10:08:33.289022 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-832b1b8e-ead7-4174-bb7d-819a2f35e13f tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859" status: 204 len: 0 microversion: 2.1 time: 0.132404 Jun 30 10:08:33.289520 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 451/887] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 10:08:33 2022] DELETE /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 10:08:33.295553 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:33.296396 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:33.300531 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-453d21c1-0749-45e6-8526-e7a9488723c8 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:33.301137 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-453d21c1-0749-45e6-8526-e7a9488723c8 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 1802a0eb-4ac0-4939-b119-af84e90c5859] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:08:33.308961 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-453d21c1-0749-45e6-8526-e7a9488723c8 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:33.309417 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-453d21c1-0749-45e6-8526-e7a9488723c8 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:33.310185 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-453d21c1-0749-45e6-8526-e7a9488723c8 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:33.310601 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-453d21c1-0749-45e6-8526-e7a9488723c8 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:33.448345 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-453d21c1-0749-45e6-8526-e7a9488723c8 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:08:33.456483 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-453d21c1-0749-45e6-8526-e7a9488723c8 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859" status: 200 len: 1576 microversion: 2.1 time: 0.162494 Jun 30 10:08:33.457047 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 437/888] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:08:33 2022] GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:34.475066 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ddc6f913-930a-4ac3-8cba-bc0e27643219 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:34.475810 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-ddc6f913-930a-4ac3-8cba-bc0e27643219 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 1802a0eb-4ac0-4939-b119-af84e90c5859] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:08:34.482331 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ddc6f913-930a-4ac3-8cba-bc0e27643219 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:34.482769 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ddc6f913-930a-4ac3-8cba-bc0e27643219 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:34.483531 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ddc6f913-930a-4ac3-8cba-bc0e27643219 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:34.483999 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ddc6f913-930a-4ac3-8cba-bc0e27643219 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:34.626332 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ddc6f913-930a-4ac3-8cba-bc0e27643219 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:08:34.634307 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ddc6f913-930a-4ac3-8cba-bc0e27643219 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859" status: 200 len: 1576 microversion: 2.1 time: 0.164188 Jun 30 10:08:34.634837 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 452/889] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:08:34 2022] GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:35.656813 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-d481e766-38cf-49bf-98c3-3dca49cbaf9c tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:35.657529 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-d481e766-38cf-49bf-98c3-3dca49cbaf9c tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 1802a0eb-4ac0-4939-b119-af84e90c5859] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:08:35.665853 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d481e766-38cf-49bf-98c3-3dca49cbaf9c tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:35.666950 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d481e766-38cf-49bf-98c3-3dca49cbaf9c tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:35.667718 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d481e766-38cf-49bf-98c3-3dca49cbaf9c tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:35.668180 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d481e766-38cf-49bf-98c3-3dca49cbaf9c tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:35.937860 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-d481e766-38cf-49bf-98c3-3dca49cbaf9c tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:08:35.953156 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-d481e766-38cf-49bf-98c3-3dca49cbaf9c tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859" status: 200 len: 1576 microversion: 2.1 time: 0.293406 Jun 30 10:08:35.953156 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 438/890] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:08:35 2022] GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859 => generated 1576 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:36.964867 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-1b854dcb-a344-4f49-b7fa-477c11301b6c tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:36.965451 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-1b854dcb-a344-4f49-b7fa-477c11301b6c tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 1802a0eb-4ac0-4939-b119-af84e90c5859] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:08:36.973039 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1b854dcb-a344-4f49-b7fa-477c11301b6c tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:36.973601 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1b854dcb-a344-4f49-b7fa-477c11301b6c tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:36.974432 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1b854dcb-a344-4f49-b7fa-477c11301b6c tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:36.975124 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1b854dcb-a344-4f49-b7fa-477c11301b6c tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:37.057259 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-1b854dcb-a344-4f49-b7fa-477c11301b6c tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:08:37.066862 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-1b854dcb-a344-4f49-b7fa-477c11301b6c tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859" status: 200 len: 1509 microversion: 2.1 time: 0.105908 Jun 30 10:08:37.076434 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 453/891] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:08:36 2022] GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859 => generated 1509 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:37.150857 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [req-9ae08f4f-ab14-4093-8722-bcb02b9821a1 req-36c94d5b-1fdf-4037-9f2d-2c39575d2210 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1802a0eb-4ac0-4939-b119-af84e90c5859", "name": "network-vif-deleted", "tag": "25a1c145-b1e0-489f-b51e-b65ee144d124"}]} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:08:37.161737 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-9ae08f4f-ab14-4093-8722-bcb02b9821a1 req-36c94d5b-1fdf-4037-9f2d-2c39575d2210 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:37.162329 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-9ae08f4f-ab14-4093-8722-bcb02b9821a1 req-36c94d5b-1fdf-4037-9f2d-2c39575d2210 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:37.174915 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.compute.server_external_events [req-9ae08f4f-ab14-4093-8722-bcb02b9821a1 req-36c94d5b-1fdf-4037-9f2d-2c39575d2210 service nova] Creating event network-vif-deleted:25a1c145-b1e0-489f-b51e-b65ee144d124 for instance 1802a0eb-4ac0-4939-b119-af84e90c5859 on hv-cinder-84330 Jun 30 10:08:37.180965 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [req-9ae08f4f-ab14-4093-8722-bcb02b9821a1 req-36c94d5b-1fdf-4037-9f2d-2c39575d2210 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033811 Jun 30 10:08:37.181635 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 439/892] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:08:38.083924 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e7188f52-8a8e-4570-81fe-2fb4fdd664f8 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:38.084638 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-e7188f52-8a8e-4570-81fe-2fb4fdd664f8 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 1802a0eb-4ac0-4939-b119-af84e90c5859] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:08:38.091596 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e7188f52-8a8e-4570-81fe-2fb4fdd664f8 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:38.092075 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e7188f52-8a8e-4570-81fe-2fb4fdd664f8 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:38.092867 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e7188f52-8a8e-4570-81fe-2fb4fdd664f8 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:38.093334 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e7188f52-8a8e-4570-81fe-2fb4fdd664f8 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:38.109600 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-e7188f52-8a8e-4570-81fe-2fb4fdd664f8 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] HTTP exception thrown: Instance 1802a0eb-4ac0-4939-b119-af84e90c5859 could not be found. Jun 30 10:08:38.111421 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e7188f52-8a8e-4570-81fe-2fb4fdd664f8 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Request method failure captured: Jun 30 10:08:38.111421 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: request: GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859 HTTP/1.1 Jun 30 10:08:38.111421 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept: application/json Jun 30 10:08:38.111421 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jun 30 10:08:38.111421 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Connection: close Jun 30 10:08:38.111421 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jun 30 10:08:38.111421 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jun 30 10:08:38.111421 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Host: 10.222.0.16 Jun 30 10:08:38.111421 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jun 30 10:08:38.111421 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jun 30 10:08:38.111421 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABivXV52OD_4Rc9L3x6-t_Z1lNdOD-WFD2ojgW-2JKeZGoZHbpypR-rdoNl09Ij-K_fFClJQU2sEjXV1toYuhue3UW9VcXZ_9kNxqCkETc-0LJvGV1J0XlnsL8h5_RyD57luBBUztLHMf5Zix_mSPGFqYW_X5HpyPAE0L2QT7PaLxmaRIY Jun 30 10:08:38.111421 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jun 30 10:08:38.111421 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jun 30 10:08:38.111421 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jun 30 10:08:38.111421 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jun 30 10:08:38.111421 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jun 30 10:08:38.111421 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jun 30 10:08:38.111421 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Id: 108ee256fba04d1b83fe00c166742f0b Jun 30 10:08:38.111421 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-TestVolumeBootPattern-755875873 Jun 30 10:08:38.111421 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Role: reader,member Jun 30 10:08:38.111421 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Roles: reader,member Jun 30 10:08:38.112941 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/108ee256fba04d1b83fe00c166742f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/108ee256fba04d1b83fe00c166742f0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/108ee256fba04d1b83fe00c166742f0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_108ee256fba04d1b83fe00c166742f0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:08:38.112941 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-TestVolumeBootPattern-755875873 Jun 30 10:08:38.112941 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 108ee256fba04d1b83fe00c166742f0b Jun 30 10:08:38.112941 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-TestVolumeBootPattern-755875873 Jun 30 10:08:38.112941 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User: tempest-TestVolumeBootPattern-755875873-project Jun 30 10:08:38.112941 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jun 30 10:08:38.112941 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jun 30 10:08:38.112941 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Id: ead8ee09f8514e75882c877042764a92 Jun 30 10:08:38.112941 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-TestVolumeBootPattern-755875873-project Jun 30 10:08:38.112941 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: method: > Jun 30 10:08:38.112941 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: exception: Instance 1802a0eb-4ac0-4939-b119-af84e90c5859 could not be found. Jun 30 10:08:38.112941 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: action_args: {'id': '1802a0eb-4ac0-4939-b119-af84e90c5859'} Jun 30 10:08:38.113794 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:08:38.113794 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:08:38.113794 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:08:38.113794 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:08:38.113794 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:08:38.113794 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:08:38.113794 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:08:38.113794 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:08:38.113794 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:08:38.113794 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:08:38.113794 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1802a0eb-4ac0-4939-b119-af84e90c5859 could not be found. Jun 30 10:08:38.113794 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:08:38.113794 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:08:38.113794 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:08:38.113794 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:08:38.113794 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:08:38.113794 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:08:38.113794 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:08:38.113794 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:08:38.113794 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:08:38.115115 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:08:38.115115 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:08:38.115115 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:08:38.115115 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:08:38.115115 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:08:38.115115 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:08:38.115115 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:08:38.115115 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1802a0eb-4ac0-4939-b119-af84e90c5859 could not be found. Jun 30 10:08:38.115115 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:08:38.115115 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:08:38.115115 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:08:38.115115 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:08:38.115115 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:08:38.115115 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:08:38.115115 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:08:38.115115 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:08:38.115115 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1802a0eb-4ac0-4939-b119-af84e90c5859 could not be found. Jun 30 10:08:38.115115 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:08:38.116358 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e7188f52-8a8e-4570-81fe-2fb4fdd664f8 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Returning 404 to user: Instance 1802a0eb-4ac0-4939-b119-af84e90c5859 could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:08:38.116358 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-e7188f52-8a8e-4570-81fe-2fb4fdd664f8 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859" status: 404 len: 111 microversion: 2.1 time: 0.033632 Jun 30 10:08:38.116358 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 454/893] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:08:38 2022] GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:08:38.210530 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-63602b9d-b954-41f9-936f-9e16bd3e55ea tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-615619235", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-121302753", "security_groups": [{"name": "tempest-secgroup-smoke-532297396"}], "block_device_mapping_v2": [{"uuid": "a359a1d5-81b5-4d24-aab1-fe1d537fcbf0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2b00bb97-ebc4-4ba6-81b4-d993140665ad"}]}} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:08:38.326735 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.network.neutron [None req-63602b9d-b954-41f9-936f-9e16bd3e55ea tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] validate_networks() for [('2b00bb97-ebc4-4ba6-81b4-d993140665ad', None, None, None, None, None)] {{(pid=117847) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 10:08:38.707218 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-63602b9d-b954-41f9-936f-9e16bd3e55ea tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Flavor limits 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 10:08:38.707667 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-63602b9d-b954-41f9-936f-9e16bd3e55ea tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Image limits 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 10:08:38.708193 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-63602b9d-b954-41f9-936f-9e16bd3e55ea tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Flavor pref 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 10:08:38.708615 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-63602b9d-b954-41f9-936f-9e16bd3e55ea tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Image pref 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 10:08:38.709022 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-63602b9d-b954-41f9-936f-9e16bd3e55ea tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 10:08:38.718092 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-63602b9d-b954-41f9-936f-9e16bd3e55ea tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:38.718535 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-63602b9d-b954-41f9-936f-9e16bd3e55ea tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:38.719324 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-63602b9d-b954-41f9-936f-9e16bd3e55ea tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:38.719798 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-63602b9d-b954-41f9-936f-9e16bd3e55ea tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:38.737085 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.quota [None req-63602b9d-b954-41f9-936f-9e16bd3e55ea tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Getting quotas for project 108ee256fba04d1b83fe00c166742f0b. Resources: {'ram', 'instances', 'cores'} {{(pid=117847) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:08:38.741665 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.quota [None req-63602b9d-b954-41f9-936f-9e16bd3e55ea tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Getting quotas for user ead8ee09f8514e75882c877042764a92 and project 108ee256fba04d1b83fe00c166742f0b. Resources: {'ram', 'instances', 'cores'} {{(pid=117847) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:08:38.818474 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-63602b9d-b954-41f9-936f-9e16bd3e55ea tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Going to run 1 instances... {{(pid=117847) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 10:08:38.820760 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-63602b9d-b954-41f9-936f-9e16bd3e55ea tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 45794da3-96ef-4de2-9c53-81638fbfe2f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a359a1d5-81b5-4d24-aab1-fe1d537fcbf0',volume_size=None,volume_type=None)] {{(pid=117847) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 10:08:39.002966 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-63602b9d-b954-41f9-936f-9e16bd3e55ea tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.796987 Jun 30 10:08:39.004684 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 440/894] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jun 30 10:08:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 10:08:39.014801 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-863abb9f-fc1b-43c0-895e-7d45550182c1 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:39.015562 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-863abb9f-fc1b-43c0-895e-7d45550182c1 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 45794da3-96ef-4de2-9c53-81638fbfe2f2] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:08:39.086132 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-863abb9f-fc1b-43c0-895e-7d45550182c1 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:08:39.096258 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-863abb9f-fc1b-43c0-895e-7d45550182c1 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/45794da3-96ef-4de2-9c53-81638fbfe2f2" status: 200 len: 1093 microversion: 2.1 time: 0.083806 Jun 30 10:08:39.106714 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 455/895] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:08:39 2022] GET /compute/v2.1/servers/45794da3-96ef-4de2-9c53-81638fbfe2f2 => generated 1093 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:39.133273 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-b2c6dbd1-46b6-4e1c-aa69-c2efe7d7aa99 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:39.133860 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-b2c6dbd1-46b6-4e1c-aa69-c2efe7d7aa99 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:08:39.141986 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b2c6dbd1-46b6-4e1c-aa69-c2efe7d7aa99 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:39.142471 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b2c6dbd1-46b6-4e1c-aa69-c2efe7d7aa99 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:39.143267 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b2c6dbd1-46b6-4e1c-aa69-c2efe7d7aa99 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:39.143789 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b2c6dbd1-46b6-4e1c-aa69-c2efe7d7aa99 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:39.304386 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.objects.instance [None req-b2c6dbd1-46b6-4e1c-aa69-c2efe7d7aa99 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lazy-loading 'services' on Instance uuid 27789fd0-038a-4d0d-b26f-4b5f5c0d8685 {{(pid=117847) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:08:39.428040 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-b2c6dbd1-46b6-4e1c-aa69-c2efe7d7aa99 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "DELETE /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685/os-volume_attachments/82596e47-0f38-4d76-99e3-61c2ff9909aa" status: 202 len: 0 microversion: 2.1 time: 0.303138 Jun 30 10:08:39.431638 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 441/896] 10.222.0.16 () {58 vars in 1415 bytes} [Thu Jun 30 10:08:39 2022] DELETE /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685/os-volume_attachments/82596e47-0f38-4d76-99e3-61c2ff9909aa => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:08:40.113378 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-3cb8ebdb-9611-4156-811e-5ff46cbef378 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:40.113916 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-3cb8ebdb-9611-4156-811e-5ff46cbef378 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 45794da3-96ef-4de2-9c53-81638fbfe2f2] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:08:40.123032 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3cb8ebdb-9611-4156-811e-5ff46cbef378 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:40.123533 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3cb8ebdb-9611-4156-811e-5ff46cbef378 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:40.124500 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3cb8ebdb-9611-4156-811e-5ff46cbef378 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:40.124871 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3cb8ebdb-9611-4156-811e-5ff46cbef378 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:40.192396 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-3cb8ebdb-9611-4156-811e-5ff46cbef378 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:08:40.200085 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-3cb8ebdb-9611-4156-811e-5ff46cbef378 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/45794da3-96ef-4de2-9c53-81638fbfe2f2" status: 200 len: 1191 microversion: 2.1 time: 0.091019 Jun 30 10:08:40.200672 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 456/897] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:08:40 2022] GET /compute/v2.1/servers/45794da3-96ef-4de2-9c53-81638fbfe2f2 => generated 1191 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:40.560485 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-6d329a79-daac-4cd3-9f88-92d1d36efc05 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:08:40.568718 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-6d329a79-daac-4cd3-9f88-92d1d36efc05 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:40.569351 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-6d329a79-daac-4cd3-9f88-92d1d36efc05 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:40.594943 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-6d329a79-daac-4cd3-9f88-92d1d36efc05 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Going to try to stop instance {{(pid=117847) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 30 10:08:40.646406 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-6d329a79-daac-4cd3-9f88-92d1d36efc05 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "POST /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685/action" status: 202 len: 0 microversion: 2.1 time: 0.091170 Jun 30 10:08:40.655034 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-88778055-6bf4-425f-a539-b5c434e1dc11 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:40.655640 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-88778055-6bf4-425f-a539-b5c434e1dc11 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:08:40.662228 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-88778055-6bf4-425f-a539-b5c434e1dc11 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:40.662676 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-88778055-6bf4-425f-a539-b5c434e1dc11 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:40.663530 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-88778055-6bf4-425f-a539-b5c434e1dc11 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:40.664102 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-88778055-6bf4-425f-a539-b5c434e1dc11 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:40.667956 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 442/898] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Jun 30 10:08:40 2022] POST /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:08:40.905591 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-88778055-6bf4-425f-a539-b5c434e1dc11 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:08:40.918355 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-88778055-6bf4-425f-a539-b5c434e1dc11 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 200 len: 1678 microversion: 2.1 time: 0.267066 Jun 30 10:08:40.919076 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 457/899] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:08:40 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 1678 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:41.218765 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-7772e42e-5c63-42ec-bbc9-f8a69c70b046 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:41.219494 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-7772e42e-5c63-42ec-bbc9-f8a69c70b046 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 45794da3-96ef-4de2-9c53-81638fbfe2f2] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:08:41.226603 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7772e42e-5c63-42ec-bbc9-f8a69c70b046 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:41.227042 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7772e42e-5c63-42ec-bbc9-f8a69c70b046 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:41.228337 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7772e42e-5c63-42ec-bbc9-f8a69c70b046 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:41.229004 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7772e42e-5c63-42ec-bbc9-f8a69c70b046 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:41.459111 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-7772e42e-5c63-42ec-bbc9-f8a69c70b046 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:08:41.471778 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-7772e42e-5c63-42ec-bbc9-f8a69c70b046 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/45794da3-96ef-4de2-9c53-81638fbfe2f2" status: 200 len: 1264 microversion: 2.1 time: 0.257580 Jun 30 10:08:41.484272 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 443/900] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:08:41 2022] GET /compute/v2.1/servers/45794da3-96ef-4de2-9c53-81638fbfe2f2 => generated 1264 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:41.941499 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-0799722f-94bc-4bd6-9eca-60d7ac8c8aca tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:41.942130 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-0799722f-94bc-4bd6-9eca-60d7ac8c8aca tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:08:41.948775 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0799722f-94bc-4bd6-9eca-60d7ac8c8aca tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:41.949214 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0799722f-94bc-4bd6-9eca-60d7ac8c8aca tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:41.949977 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0799722f-94bc-4bd6-9eca-60d7ac8c8aca tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:41.950398 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0799722f-94bc-4bd6-9eca-60d7ac8c8aca tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:42.079234 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [req-cf00211f-0211-41f5-85e0-68dd78945ed2 req-3ec90060-587b-4eef-9614-eb6e50efcbba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45794da3-96ef-4de2-9c53-81638fbfe2f2", "tag": "ce90e702-7fe9-494e-a81c-004285bde603"}]} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:08:42.109410 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-cf00211f-0211-41f5-85e0-68dd78945ed2 req-3ec90060-587b-4eef-9614-eb6e50efcbba service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:42.110143 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-cf00211f-0211-41f5-85e0-68dd78945ed2 req-3ec90060-587b-4eef-9614-eb6e50efcbba service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:42.124423 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.compute.server_external_events [req-cf00211f-0211-41f5-85e0-68dd78945ed2 req-3ec90060-587b-4eef-9614-eb6e50efcbba service nova] Creating event network-changed:ce90e702-7fe9-494e-a81c-004285bde603 for instance 45794da3-96ef-4de2-9c53-81638fbfe2f2 on hv-cinder-84330 Jun 30 10:08:42.129688 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [req-cf00211f-0211-41f5-85e0-68dd78945ed2 req-3ec90060-587b-4eef-9614-eb6e50efcbba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055954 Jun 30 10:08:42.131244 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 444/901] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:08:42.202073 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-0799722f-94bc-4bd6-9eca-60d7ac8c8aca tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:08:42.214094 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-0799722f-94bc-4bd6-9eca-60d7ac8c8aca tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 200 len: 1678 microversion: 2.1 time: 0.276511 Jun 30 10:08:42.214924 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 458/902] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:08:41 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 1678 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:42.490403 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-80869102-025b-4a74-8e2e-29e9db0033cb tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:42.491534 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-80869102-025b-4a74-8e2e-29e9db0033cb tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 45794da3-96ef-4de2-9c53-81638fbfe2f2] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:08:42.497963 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-80869102-025b-4a74-8e2e-29e9db0033cb tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:42.498410 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-80869102-025b-4a74-8e2e-29e9db0033cb tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:42.499173 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-80869102-025b-4a74-8e2e-29e9db0033cb tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:42.499772 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-80869102-025b-4a74-8e2e-29e9db0033cb tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:42.648752 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-80869102-025b-4a74-8e2e-29e9db0033cb tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:08:42.656370 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-80869102-025b-4a74-8e2e-29e9db0033cb tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/45794da3-96ef-4de2-9c53-81638fbfe2f2" status: 200 len: 1264 microversion: 2.1 time: 0.170805 Jun 30 10:08:42.656960 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 445/903] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:08:42 2022] GET /compute/v2.1/servers/45794da3-96ef-4de2-9c53-81638fbfe2f2 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:43.231899 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-dd0b9c8d-b9d7-41f9-837a-f39d3668c302 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:43.232612 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-dd0b9c8d-b9d7-41f9-837a-f39d3668c302 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:08:43.239712 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-dd0b9c8d-b9d7-41f9-837a-f39d3668c302 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:43.240190 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-dd0b9c8d-b9d7-41f9-837a-f39d3668c302 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:43.240957 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-dd0b9c8d-b9d7-41f9-837a-f39d3668c302 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:43.241387 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-dd0b9c8d-b9d7-41f9-837a-f39d3668c302 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:43.391921 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-dd0b9c8d-b9d7-41f9-837a-f39d3668c302 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:08:43.400123 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-dd0b9c8d-b9d7-41f9-837a-f39d3668c302 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 200 len: 1678 microversion: 2.1 time: 0.172111 Jun 30 10:08:43.400677 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 459/904] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:08:43 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:43.676024 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-9649694e-1d1a-4ade-bd32-af1648a99981 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:43.676659 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-9649694e-1d1a-4ade-bd32-af1648a99981 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 45794da3-96ef-4de2-9c53-81638fbfe2f2] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:08:43.684920 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9649694e-1d1a-4ade-bd32-af1648a99981 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:43.685471 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9649694e-1d1a-4ade-bd32-af1648a99981 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:43.686575 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9649694e-1d1a-4ade-bd32-af1648a99981 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:43.687192 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9649694e-1d1a-4ade-bd32-af1648a99981 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:43.837414 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-9649694e-1d1a-4ade-bd32-af1648a99981 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:08:43.848878 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-9649694e-1d1a-4ade-bd32-af1648a99981 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/45794da3-96ef-4de2-9c53-81638fbfe2f2" status: 200 len: 1264 microversion: 2.1 time: 0.177673 Jun 30 10:08:43.849611 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 446/905] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:08:43 2022] GET /compute/v2.1/servers/45794da3-96ef-4de2-9c53-81638fbfe2f2 => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:44.417396 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-7c3de89c-a2b9-4818-8587-a7db5fee6653 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:44.417996 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-7c3de89c-a2b9-4818-8587-a7db5fee6653 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:08:44.424973 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7c3de89c-a2b9-4818-8587-a7db5fee6653 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:44.425413 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7c3de89c-a2b9-4818-8587-a7db5fee6653 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:44.426163 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7c3de89c-a2b9-4818-8587-a7db5fee6653 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:44.426586 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7c3de89c-a2b9-4818-8587-a7db5fee6653 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:44.557468 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7c3de89c-a2b9-4818-8587-a7db5fee6653 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:08:44.566164 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-7c3de89c-a2b9-4818-8587-a7db5fee6653 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 200 len: 1678 microversion: 2.1 time: 0.152681 Jun 30 10:08:44.566704 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 460/906] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:08:44 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:44.873581 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-7f378fa4-43c5-431c-be6e-0c10c20176e4 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:44.874564 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-7f378fa4-43c5-431c-be6e-0c10c20176e4 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 45794da3-96ef-4de2-9c53-81638fbfe2f2] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:08:44.881994 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7f378fa4-43c5-431c-be6e-0c10c20176e4 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:44.882441 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7f378fa4-43c5-431c-be6e-0c10c20176e4 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:44.883197 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7f378fa4-43c5-431c-be6e-0c10c20176e4 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:44.883625 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7f378fa4-43c5-431c-be6e-0c10c20176e4 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:45.030188 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-7f378fa4-43c5-431c-be6e-0c10c20176e4 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:08:45.038375 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-7f378fa4-43c5-431c-be6e-0c10c20176e4 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/45794da3-96ef-4de2-9c53-81638fbfe2f2" status: 200 len: 1264 microversion: 2.1 time: 0.171263 Jun 30 10:08:45.038936 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 447/907] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:08:44 2022] GET /compute/v2.1/servers/45794da3-96ef-4de2-9c53-81638fbfe2f2 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:45.583586 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-7ad92840-9f93-4e58-beed-81bb8de21248 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:45.584212 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-7ad92840-9f93-4e58-beed-81bb8de21248 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:08:45.590813 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7ad92840-9f93-4e58-beed-81bb8de21248 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:45.591252 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7ad92840-9f93-4e58-beed-81bb8de21248 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:45.592037 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7ad92840-9f93-4e58-beed-81bb8de21248 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:45.592460 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7ad92840-9f93-4e58-beed-81bb8de21248 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:45.729749 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7ad92840-9f93-4e58-beed-81bb8de21248 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:08:45.737536 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-7ad92840-9f93-4e58-beed-81bb8de21248 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 200 len: 1678 microversion: 2.1 time: 0.158100 Jun 30 10:08:45.738085 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 461/908] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:08:45 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:46.059739 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-db71e147-f085-47fa-9902-8b983aa0e4f7 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:46.060673 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-db71e147-f085-47fa-9902-8b983aa0e4f7 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 45794da3-96ef-4de2-9c53-81638fbfe2f2] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:08:46.072235 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-db71e147-f085-47fa-9902-8b983aa0e4f7 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:46.072972 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-db71e147-f085-47fa-9902-8b983aa0e4f7 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:46.074230 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-db71e147-f085-47fa-9902-8b983aa0e4f7 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:46.074948 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-db71e147-f085-47fa-9902-8b983aa0e4f7 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:46.221649 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-db71e147-f085-47fa-9902-8b983aa0e4f7 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:08:46.229620 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-db71e147-f085-47fa-9902-8b983aa0e4f7 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/45794da3-96ef-4de2-9c53-81638fbfe2f2" status: 200 len: 1264 microversion: 2.1 time: 0.176861 Jun 30 10:08:46.230190 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 448/909] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:08:46 2022] GET /compute/v2.1/servers/45794da3-96ef-4de2-9c53-81638fbfe2f2 => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:46.755057 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-11e0f5d6-c9f9-4503-9b64-c6c49650d95f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:46.755749 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-11e0f5d6-c9f9-4503-9b64-c6c49650d95f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:08:46.762499 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-11e0f5d6-c9f9-4503-9b64-c6c49650d95f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:46.762955 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-11e0f5d6-c9f9-4503-9b64-c6c49650d95f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:46.763780 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-11e0f5d6-c9f9-4503-9b64-c6c49650d95f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:46.764280 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-11e0f5d6-c9f9-4503-9b64-c6c49650d95f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:46.900700 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-11e0f5d6-c9f9-4503-9b64-c6c49650d95f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:08:46.912106 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-11e0f5d6-c9f9-4503-9b64-c6c49650d95f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 200 len: 1678 microversion: 2.1 time: 0.160549 Jun 30 10:08:46.912692 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 462/910] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:08:46 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:47.246226 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-64e418e3-2dd7-4e2f-80e5-387537dfc19a tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:47.246788 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-64e418e3-2dd7-4e2f-80e5-387537dfc19a tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 45794da3-96ef-4de2-9c53-81638fbfe2f2] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:08:47.253476 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-64e418e3-2dd7-4e2f-80e5-387537dfc19a tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:47.253899 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-64e418e3-2dd7-4e2f-80e5-387537dfc19a tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:47.254652 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-64e418e3-2dd7-4e2f-80e5-387537dfc19a tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:47.255074 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-64e418e3-2dd7-4e2f-80e5-387537dfc19a tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:47.391944 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-64e418e3-2dd7-4e2f-80e5-387537dfc19a tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:08:47.400021 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-64e418e3-2dd7-4e2f-80e5-387537dfc19a tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/45794da3-96ef-4de2-9c53-81638fbfe2f2" status: 200 len: 1264 microversion: 2.1 time: 0.157757 Jun 30 10:08:47.400670 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 449/911] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:08:47 2022] GET /compute/v2.1/servers/45794da3-96ef-4de2-9c53-81638fbfe2f2 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:47.937779 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-78b9abc0-78fa-488a-a64c-bd304c291d4c tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:47.938699 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-78b9abc0-78fa-488a-a64c-bd304c291d4c tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:08:47.947008 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-78b9abc0-78fa-488a-a64c-bd304c291d4c tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:47.947454 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-78b9abc0-78fa-488a-a64c-bd304c291d4c tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:47.948257 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-78b9abc0-78fa-488a-a64c-bd304c291d4c tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:47.948685 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-78b9abc0-78fa-488a-a64c-bd304c291d4c tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:48.090385 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-78b9abc0-78fa-488a-a64c-bd304c291d4c tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:08:48.100890 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-78b9abc0-78fa-488a-a64c-bd304c291d4c tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 200 len: 1678 microversion: 2.1 time: 0.169898 Jun 30 10:08:48.101634 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 463/912] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:08:47 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:48.419296 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-33f377e2-c285-43ab-b7f8-174639bc2956 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:48.419950 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-33f377e2-c285-43ab-b7f8-174639bc2956 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 45794da3-96ef-4de2-9c53-81638fbfe2f2] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:08:48.426774 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-33f377e2-c285-43ab-b7f8-174639bc2956 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:48.427242 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-33f377e2-c285-43ab-b7f8-174639bc2956 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:48.428056 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-33f377e2-c285-43ab-b7f8-174639bc2956 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:48.428465 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-33f377e2-c285-43ab-b7f8-174639bc2956 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:48.561535 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-33f377e2-c285-43ab-b7f8-174639bc2956 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:08:48.569593 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-33f377e2-c285-43ab-b7f8-174639bc2956 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/45794da3-96ef-4de2-9c53-81638fbfe2f2" status: 200 len: 1264 microversion: 2.1 time: 0.155075 Jun 30 10:08:48.570193 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 450/913] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:08:48 2022] GET /compute/v2.1/servers/45794da3-96ef-4de2-9c53-81638fbfe2f2 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:49.123005 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-2e0586cd-8682-442a-8149-b953da9c7787 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:49.123809 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-2e0586cd-8682-442a-8149-b953da9c7787 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:08:49.126038 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=2 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:49.132141 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2e0586cd-8682-442a-8149-b953da9c7787 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:49.132622 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2e0586cd-8682-442a-8149-b953da9c7787 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:49.133378 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2e0586cd-8682-442a-8149-b953da9c7787 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:49.134202 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2e0586cd-8682-442a-8149-b953da9c7787 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:49.273705 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-2e0586cd-8682-442a-8149-b953da9c7787 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:08:49.281849 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-2e0586cd-8682-442a-8149-b953da9c7787 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 200 len: 1678 microversion: 2.1 time: 0.163009 Jun 30 10:08:49.282411 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 464/914] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:08:49 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:49.587110 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-a001c2d2-ea5f-46ad-a8f0-d634089ec7e4 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:49.587706 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-a001c2d2-ea5f-46ad-a8f0-d634089ec7e4 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 45794da3-96ef-4de2-9c53-81638fbfe2f2] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:08:49.589722 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell0:SELECT=2 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:49.590443 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell0:SELECT=6 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:49.597035 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a001c2d2-ea5f-46ad-a8f0-d634089ec7e4 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:49.597473 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a001c2d2-ea5f-46ad-a8f0-d634089ec7e4 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:49.598601 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a001c2d2-ea5f-46ad-a8f0-d634089ec7e4 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:49.599037 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a001c2d2-ea5f-46ad-a8f0-d634089ec7e4 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:49.745800 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-a001c2d2-ea5f-46ad-a8f0-d634089ec7e4 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:08:49.755644 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-a001c2d2-ea5f-46ad-a8f0-d634089ec7e4 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/45794da3-96ef-4de2-9c53-81638fbfe2f2" status: 200 len: 1264 microversion: 2.1 time: 0.172803 Jun 30 10:08:49.756280 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 451/915] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:08:49 2022] GET /compute/v2.1/servers/45794da3-96ef-4de2-9c53-81638fbfe2f2 => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:50.298737 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-6ebb9376-5a6f-4fbd-8d67-3cd7a8066814 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:50.299348 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-6ebb9376-5a6f-4fbd-8d67-3cd7a8066814 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:08:50.306767 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6ebb9376-5a6f-4fbd-8d67-3cd7a8066814 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:50.307220 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6ebb9376-5a6f-4fbd-8d67-3cd7a8066814 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:50.308347 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6ebb9376-5a6f-4fbd-8d67-3cd7a8066814 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:50.308804 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6ebb9376-5a6f-4fbd-8d67-3cd7a8066814 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:50.443347 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-6ebb9376-5a6f-4fbd-8d67-3cd7a8066814 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:08:50.451452 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-6ebb9376-5a6f-4fbd-8d67-3cd7a8066814 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 200 len: 1678 microversion: 2.1 time: 0.156662 Jun 30 10:08:50.452070 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 465/916] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:08:50 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:50.772980 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-5508007c-a665-4551-aab1-2c4fa23d94e6 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:50.773743 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-5508007c-a665-4551-aab1-2c4fa23d94e6 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 45794da3-96ef-4de2-9c53-81638fbfe2f2] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:08:50.780831 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-5508007c-a665-4551-aab1-2c4fa23d94e6 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:50.781280 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-5508007c-a665-4551-aab1-2c4fa23d94e6 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:50.782046 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-5508007c-a665-4551-aab1-2c4fa23d94e6 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:50.782476 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-5508007c-a665-4551-aab1-2c4fa23d94e6 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:51.096024 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-5508007c-a665-4551-aab1-2c4fa23d94e6 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:08:51.106157 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-5508007c-a665-4551-aab1-2c4fa23d94e6 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/45794da3-96ef-4de2-9c53-81638fbfe2f2" status: 200 len: 1264 microversion: 2.1 time: 0.337224 Jun 30 10:08:51.106726 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 452/917] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:08:50 2022] GET /compute/v2.1/servers/45794da3-96ef-4de2-9c53-81638fbfe2f2 => generated 1264 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:51.471604 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e8a111a7-3be8-456d-b39a-4804cd441d32 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:51.472381 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-e8a111a7-3be8-456d-b39a-4804cd441d32 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:08:51.479438 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e8a111a7-3be8-456d-b39a-4804cd441d32 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:51.479902 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e8a111a7-3be8-456d-b39a-4804cd441d32 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:51.480679 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e8a111a7-3be8-456d-b39a-4804cd441d32 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:51.481592 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e8a111a7-3be8-456d-b39a-4804cd441d32 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:51.554712 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [req-c9dce508-35d2-471a-a55a-5c5160290f24 req-5249c1fa-b042-4b11-9dfe-31ba89718616 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45794da3-96ef-4de2-9c53-81638fbfe2f2", "name": "network-vif-plugged", "status": "completed", "tag": "ce90e702-7fe9-494e-a81c-004285bde603"}]} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:08:51.564151 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-c9dce508-35d2-471a-a55a-5c5160290f24 req-5249c1fa-b042-4b11-9dfe-31ba89718616 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:51.564974 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-c9dce508-35d2-471a-a55a-5c5160290f24 req-5249c1fa-b042-4b11-9dfe-31ba89718616 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:51.578261 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.compute.server_external_events [req-c9dce508-35d2-471a-a55a-5c5160290f24 req-5249c1fa-b042-4b11-9dfe-31ba89718616 service nova] Creating event network-vif-plugged:ce90e702-7fe9-494e-a81c-004285bde603 for instance 45794da3-96ef-4de2-9c53-81638fbfe2f2 on hv-cinder-84330 Jun 30 10:08:51.583649 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [req-c9dce508-35d2-471a-a55a-5c5160290f24 req-5249c1fa-b042-4b11-9dfe-31ba89718616 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032497 Jun 30 10:08:51.585178 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 453/918] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:08:51.644657 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e8a111a7-3be8-456d-b39a-4804cd441d32 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:08:51.654018 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-e8a111a7-3be8-456d-b39a-4804cd441d32 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 200 len: 1655 microversion: 2.1 time: 0.186812 Jun 30 10:08:51.654839 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 466/919] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:08:51 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 1655 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:51.671034 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-6d60529f-101b-4575-b247-77097646bc1a tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:08:51.677298 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-6d60529f-101b-4575-b247-77097646bc1a tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:51.677737 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-6d60529f-101b-4575-b247-77097646bc1a tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:51.697993 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:51.703353 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-6d60529f-101b-4575-b247-77097646bc1a tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Going to try to start instance {{(pid=117847) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 30 10:08:51.752005 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-6d60529f-101b-4575-b247-77097646bc1a tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "POST /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685/action" status: 202 len: 0 microversion: 2.1 time: 0.084479 Jun 30 10:08:51.752958 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 454/920] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Jun 30 10:08:51 2022] POST /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:08:51.761582 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-04733bf0-83dc-4cb2-8d77-4fa747e29a6c tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:51.762633 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-04733bf0-83dc-4cb2-8d77-4fa747e29a6c tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:08:51.769393 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-04733bf0-83dc-4cb2-8d77-4fa747e29a6c tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:51.770044 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-04733bf0-83dc-4cb2-8d77-4fa747e29a6c tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:51.771080 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-04733bf0-83dc-4cb2-8d77-4fa747e29a6c tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:51.771794 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-04733bf0-83dc-4cb2-8d77-4fa747e29a6c tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:51.795897 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:52.020735 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-04733bf0-83dc-4cb2-8d77-4fa747e29a6c tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:08:52.028469 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-04733bf0-83dc-4cb2-8d77-4fa747e29a6c tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 200 len: 1664 microversion: 2.1 time: 0.271422 Jun 30 10:08:52.029033 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 467/921] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:08:51 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 1664 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:52.123810 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-a10f51f2-faff-4837-9375-478e28429f5f tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:52.125264 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-a10f51f2-faff-4837-9375-478e28429f5f tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 45794da3-96ef-4de2-9c53-81638fbfe2f2] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:08:52.131896 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a10f51f2-faff-4837-9375-478e28429f5f tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:52.132311 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a10f51f2-faff-4837-9375-478e28429f5f tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:52.133079 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a10f51f2-faff-4837-9375-478e28429f5f tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:52.133503 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a10f51f2-faff-4837-9375-478e28429f5f tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:52.351118 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-a10f51f2-faff-4837-9375-478e28429f5f tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:08:52.359167 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-a10f51f2-faff-4837-9375-478e28429f5f tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/45794da3-96ef-4de2-9c53-81638fbfe2f2" status: 200 len: 1264 microversion: 2.1 time: 0.240038 Jun 30 10:08:52.359725 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 455/922] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:08:52 2022] GET /compute/v2.1/servers/45794da3-96ef-4de2-9c53-81638fbfe2f2 => generated 1264 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:53.046513 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-fa979285-40d9-47bf-a496-99c5f8ccd7bd tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:53.047120 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-fa979285-40d9-47bf-a496-99c5f8ccd7bd tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:08:53.054274 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fa979285-40d9-47bf-a496-99c5f8ccd7bd tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:53.054725 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fa979285-40d9-47bf-a496-99c5f8ccd7bd tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:53.055493 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fa979285-40d9-47bf-a496-99c5f8ccd7bd tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:53.055977 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fa979285-40d9-47bf-a496-99c5f8ccd7bd tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:53.195086 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-fa979285-40d9-47bf-a496-99c5f8ccd7bd tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:08:53.203535 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-fa979285-40d9-47bf-a496-99c5f8ccd7bd tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 200 len: 1664 microversion: 2.1 time: 0.160847 Jun 30 10:08:53.204403 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 468/923] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:08:53 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 1664 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:53.376451 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-7ce53e60-e1eb-4514-936f-bc078eb490f9 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:53.377058 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-7ce53e60-e1eb-4514-936f-bc078eb490f9 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 45794da3-96ef-4de2-9c53-81638fbfe2f2] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:08:53.384144 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7ce53e60-e1eb-4514-936f-bc078eb490f9 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:53.384581 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7ce53e60-e1eb-4514-936f-bc078eb490f9 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:53.385345 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7ce53e60-e1eb-4514-936f-bc078eb490f9 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:53.386371 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7ce53e60-e1eb-4514-936f-bc078eb490f9 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:53.700872 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-7ce53e60-e1eb-4514-936f-bc078eb490f9 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:08:53.709544 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-7ce53e60-e1eb-4514-936f-bc078eb490f9 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/45794da3-96ef-4de2-9c53-81638fbfe2f2" status: 200 len: 1451 microversion: 2.1 time: 0.337046 Jun 30 10:08:53.710213 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 456/924] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:08:53 2022] GET /compute/v2.1/servers/45794da3-96ef-4de2-9c53-81638fbfe2f2 => generated 1451 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:53.726560 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e81984be-b8c7-48a1-90b8-f639c9e9627c tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:53.727332 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-e81984be-b8c7-48a1-90b8-f639c9e9627c tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 45794da3-96ef-4de2-9c53-81638fbfe2f2] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:08:53.733956 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e81984be-b8c7-48a1-90b8-f639c9e9627c tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:53.734472 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e81984be-b8c7-48a1-90b8-f639c9e9627c tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:53.735307 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e81984be-b8c7-48a1-90b8-f639c9e9627c tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:53.735800 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e81984be-b8c7-48a1-90b8-f639c9e9627c tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:53.922902 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e81984be-b8c7-48a1-90b8-f639c9e9627c tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:08:53.937753 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-e81984be-b8c7-48a1-90b8-f639c9e9627c tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/45794da3-96ef-4de2-9c53-81638fbfe2f2" status: 200 len: 1451 microversion: 2.1 time: 0.215310 Jun 30 10:08:53.938360 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 469/925] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:08:53 2022] GET /compute/v2.1/servers/45794da3-96ef-4de2-9c53-81638fbfe2f2 => generated 1451 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:54.222738 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-9e41c354-0eec-4b4f-855f-7f67115fde82 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:54.224275 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-9e41c354-0eec-4b4f-855f-7f67115fde82 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:08:54.232445 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9e41c354-0eec-4b4f-855f-7f67115fde82 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:54.232897 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9e41c354-0eec-4b4f-855f-7f67115fde82 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:54.233675 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9e41c354-0eec-4b4f-855f-7f67115fde82 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:54.234110 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9e41c354-0eec-4b4f-855f-7f67115fde82 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:54.459305 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-9e41c354-0eec-4b4f-855f-7f67115fde82 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:08:54.478085 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-9e41c354-0eec-4b4f-855f-7f67115fde82 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 200 len: 1664 microversion: 2.1 time: 0.257542 Jun 30 10:08:54.486435 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 457/926] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:08:54 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 1664 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:55.495155 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-57a4c5e6-05d4-4e30-b0ba-7638c7ba29b5 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:08:55.495734 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-57a4c5e6-05d4-4e30-b0ba-7638c7ba29b5 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:08:55.502155 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-57a4c5e6-05d4-4e30-b0ba-7638c7ba29b5 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:55.502594 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-57a4c5e6-05d4-4e30-b0ba-7638c7ba29b5 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:55.503373 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-57a4c5e6-05d4-4e30-b0ba-7638c7ba29b5 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:55.503799 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-57a4c5e6-05d4-4e30-b0ba-7638c7ba29b5 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:55.727777 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-57a4c5e6-05d4-4e30-b0ba-7638c7ba29b5 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:08:55.737058 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-57a4c5e6-05d4-4e30-b0ba-7638c7ba29b5 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 200 len: 1668 microversion: 2.1 time: 0.245590 Jun 30 10:08:55.748127 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 470/927] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:08:55 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 1668 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:55.841518 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [req-88b223b1-e54a-4eb4-ac65-bcb488588904 req-8f4bb191-08cb-44a5-9ea0-934d16517c0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45794da3-96ef-4de2-9c53-81638fbfe2f2", "tag": "ce90e702-7fe9-494e-a81c-004285bde603"}]} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:08:55.850828 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-88b223b1-e54a-4eb4-ac65-bcb488588904 req-8f4bb191-08cb-44a5-9ea0-934d16517c0e service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:08:55.851528 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-88b223b1-e54a-4eb4-ac65-bcb488588904 req-8f4bb191-08cb-44a5-9ea0-934d16517c0e service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:08:55.863399 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.compute.server_external_events [req-88b223b1-e54a-4eb4-ac65-bcb488588904 req-8f4bb191-08cb-44a5-9ea0-934d16517c0e service nova] Creating event network-changed:ce90e702-7fe9-494e-a81c-004285bde603 for instance 45794da3-96ef-4de2-9c53-81638fbfe2f2 on hv-cinder-84330 Jun 30 10:08:55.869357 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [req-88b223b1-e54a-4eb4-ac65-bcb488588904 req-8f4bb191-08cb-44a5-9ea0-934d16517c0e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032731 Jun 30 10:08:55.870096 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 458/928] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:09:09.209092 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 10:09:09.209690 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Thu Jun 30 10:09:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 10:09:13.011386 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 10:09:13.012401 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Thu Jun 30 10:09:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 10:09:24.120633 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:24.122108 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=20 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:24.304878 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-85a8ae38-330a-42b5-a418-27414a3d478e tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Action: 'create', calling method: .version_select at 0x7fc22028a040>, body: {"keypair": {"name": "tempest-TestShelveInstance-1371658480", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSRfTmwh/brBdt3bbOkXOf2jyMupg7uDY75vkXkH1JoCIs8HMtLpFkbgpayENfwQWQWD5TbVSB7t5eSXo1HeYAi41h2f4uvAS8q5tLFubLSPu+W4o7VucbjpROmBud7WQ=="}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:09:24.321385 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-85a8ae38-330a-42b5-a418-27414a3d478e tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Getting quotas for project 84c9f15ea7b84f54a6cfa004bd02de6e. Resources: {'key_pairs'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:09:24.326309 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-85a8ae38-330a-42b5-a418-27414a3d478e tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Getting quotas for user fbc71c372e584ddf91290eefb53a973a and project 84c9f15ea7b84f54a6cfa004bd02de6e. Resources: {'key_pairs'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:09:24.374407 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-85a8ae38-330a-42b5-a418-27414a3d478e tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.259147 Jun 30 10:09:24.375185 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 471/929] 10.222.0.16 () {60 vars in 1158 bytes} [Thu Jun 30 10:09:24 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:09:28.824238 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:28.824990 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:28.829702 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-3f341802-b67e-47fb-83e9-597c308d7946 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:09:28.830850 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-3f341802-b67e-47fb-83e9-597c308d7946 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:09:28.839399 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3f341802-b67e-47fb-83e9-597c308d7946 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:28.839860 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3f341802-b67e-47fb-83e9-597c308d7946 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:28.840643 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3f341802-b67e-47fb-83e9-597c308d7946 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:28.841062 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-3f341802-b67e-47fb-83e9-597c308d7946 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:28.877000 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-3f341802-b67e-47fb-83e9-597c308d7946 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054489 Jun 30 10:09:28.877692 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 459/930] 10.222.0.16 () {58 vars in 1301 bytes} [Thu Jun 30 10:09:28 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 10:09:28.937499 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-17066e99-f2bd-4938-8e76-e960bd859345 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:09:28.938025 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-17066e99-f2bd-4938-8e76-e960bd859345 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:09:28.945092 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-17066e99-f2bd-4938-8e76-e960bd859345 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:28.945542 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-17066e99-f2bd-4938-8e76-e960bd859345 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:28.946315 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-17066e99-f2bd-4938-8e76-e960bd859345 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:28.946749 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-17066e99-f2bd-4938-8e76-e960bd859345 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:28.973444 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-17066e99-f2bd-4938-8e76-e960bd859345 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Going to try to terminate instance {{(pid=117846) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 10:09:29.072543 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-17066e99-f2bd-4938-8e76-e960bd859345 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "DELETE /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 204 len: 0 microversion: 2.1 time: 0.139109 Jun 30 10:09:29.076761 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 472/931] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 10:09:28 2022] DELETE /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 10:09:29.082335 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-13fa15f3-ac76-473f-947a-e4399617cacc tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:09:29.082944 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-13fa15f3-ac76-473f-947a-e4399617cacc tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:09:29.089126 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-13fa15f3-ac76-473f-947a-e4399617cacc tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:29.089767 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-13fa15f3-ac76-473f-947a-e4399617cacc tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:29.090537 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-13fa15f3-ac76-473f-947a-e4399617cacc tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:29.090968 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-13fa15f3-ac76-473f-947a-e4399617cacc tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:29.235954 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-13fa15f3-ac76-473f-947a-e4399617cacc tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:09:29.243901 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-13fa15f3-ac76-473f-947a-e4399617cacc tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 200 len: 1674 microversion: 2.1 time: 0.165962 Jun 30 10:09:29.244465 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 460/932] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:09:29 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:09:30.262608 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ca625246-ca29-4efb-933b-162fcd45ed26 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:09:30.263173 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-ca625246-ca29-4efb-933b-162fcd45ed26 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:09:30.270239 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ca625246-ca29-4efb-933b-162fcd45ed26 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:30.270698 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ca625246-ca29-4efb-933b-162fcd45ed26 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:30.271459 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ca625246-ca29-4efb-933b-162fcd45ed26 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:30.271904 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ca625246-ca29-4efb-933b-162fcd45ed26 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:30.420350 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ca625246-ca29-4efb-933b-162fcd45ed26 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:09:30.430679 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ca625246-ca29-4efb-933b-162fcd45ed26 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 200 len: 1674 microversion: 2.1 time: 0.172116 Jun 30 10:09:30.431434 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 473/933] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:09:30 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 1674 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:09:31.452472 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-7a236c76-3c61-450d-be2c-39f5a1d85cfc tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:09:31.453709 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-7a236c76-3c61-450d-be2c-39f5a1d85cfc tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:09:31.460690 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7a236c76-3c61-450d-be2c-39f5a1d85cfc tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:31.461143 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7a236c76-3c61-450d-be2c-39f5a1d85cfc tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:31.461955 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7a236c76-3c61-450d-be2c-39f5a1d85cfc tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:31.462463 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7a236c76-3c61-450d-be2c-39f5a1d85cfc tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:31.697331 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-7a236c76-3c61-450d-be2c-39f5a1d85cfc tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:09:31.705685 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-7a236c76-3c61-450d-be2c-39f5a1d85cfc tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 200 len: 1674 microversion: 2.1 time: 0.257258 Jun 30 10:09:31.706192 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 461/934] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:09:31 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 1674 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:09:32.315010 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-809f9ed6-f245-4137-9953-6b33640960d0 req-1268dac2-8027-4f54-96d2-91cad5992bec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27789fd0-038a-4d0d-b26f-4b5f5c0d8685", "name": "network-vif-deleted", "tag": "7de241b3-2fc5-44bf-8308-4c569553de91"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:09:32.324688 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-809f9ed6-f245-4137-9953-6b33640960d0 req-1268dac2-8027-4f54-96d2-91cad5992bec service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:32.325133 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-809f9ed6-f245-4137-9953-6b33640960d0 req-1268dac2-8027-4f54-96d2-91cad5992bec service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:32.336634 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-809f9ed6-f245-4137-9953-6b33640960d0 req-1268dac2-8027-4f54-96d2-91cad5992bec service nova] Creating event network-vif-deleted:7de241b3-2fc5-44bf-8308-4c569553de91 for instance 27789fd0-038a-4d0d-b26f-4b5f5c0d8685 on hv-cinder-84330 Jun 30 10:09:32.342926 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-809f9ed6-f245-4137-9953-6b33640960d0 req-1268dac2-8027-4f54-96d2-91cad5992bec service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034694 Jun 30 10:09:32.343620 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 474/935] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:09:32.723131 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-b7067150-b55d-4d45-80fc-c6d7da11f5b1 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:09:32.723737 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-b7067150-b55d-4d45-80fc-c6d7da11f5b1 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:09:32.731223 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b7067150-b55d-4d45-80fc-c6d7da11f5b1 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:32.731899 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b7067150-b55d-4d45-80fc-c6d7da11f5b1 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:32.732810 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b7067150-b55d-4d45-80fc-c6d7da11f5b1 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:32.733307 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b7067150-b55d-4d45-80fc-c6d7da11f5b1 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:32.781911 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b7067150-b55d-4d45-80fc-c6d7da11f5b1 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:32.782665 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b7067150-b55d-4d45-80fc-c6d7da11f5b1 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:32.783272 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.objects.instance [None req-b7067150-b55d-4d45-80fc-c6d7da11f5b1 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lazy-loading 'fault' on Instance uuid 27789fd0-038a-4d0d-b26f-4b5f5c0d8685 {{(pid=117847) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:09:32.834008 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-b7067150-b55d-4d45-80fc-c6d7da11f5b1 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:09:32.841642 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-b7067150-b55d-4d45-80fc-c6d7da11f5b1 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 200 len: 1328 microversion: 2.1 time: 0.122717 Jun 30 10:09:32.842217 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 462/936] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:09:32 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 1328 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:09:33.862795 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-6f24bb38-3a68-4b82-abb2-f0e6698bd877 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:09:33.863460 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-6f24bb38-3a68-4b82-abb2-f0e6698bd877 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:09:33.872143 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6f24bb38-3a68-4b82-abb2-f0e6698bd877 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:33.872580 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6f24bb38-3a68-4b82-abb2-f0e6698bd877 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:33.873349 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6f24bb38-3a68-4b82-abb2-f0e6698bd877 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:33.873781 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6f24bb38-3a68-4b82-abb2-f0e6698bd877 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:33.887449 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-6f24bb38-3a68-4b82-abb2-f0e6698bd877 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] HTTP exception thrown: Instance 27789fd0-038a-4d0d-b26f-4b5f5c0d8685 could not be found. Jun 30 10:09:33.889243 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-6f24bb38-3a68-4b82-abb2-f0e6698bd877 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Request method failure captured: Jun 30 10:09:33.889243 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: request: GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 HTTP/1.1 Jun 30 10:09:33.889243 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept: application/json Jun 30 10:09:33.889243 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jun 30 10:09:33.889243 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Connection: close Jun 30 10:09:33.889243 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jun 30 10:09:33.889243 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jun 30 10:09:33.889243 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Host: 10.222.0.16 Jun 30 10:09:33.889243 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jun 30 10:09:33.889243 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jun 30 10:09:33.889243 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABivXWxs6lbonKih3FPtqwiwqd2Ztfdo7CEZfgC9x2JfnMf-fCsmZV8SBnPPc3NnGQGJh3lkFmLjbcopW42B9ltJ9mI1cgjujPQZo_c9oF_gq-LTWybTNeSkTE48rIge9Yscr_CM33DIuqzjrVDRjgvV1wx7M8ezz5JBTdo1xTT5q2vSUo Jun 30 10:09:33.889243 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jun 30 10:09:33.889243 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jun 30 10:09:33.889243 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jun 30 10:09:33.889243 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jun 30 10:09:33.889243 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jun 30 10:09:33.889243 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jun 30 10:09:33.889243 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Id: 315760a46046430780d7d4741cd8dc7f Jun 30 10:09:33.889243 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-AttachVolumeTestJSON-1253618327 Jun 30 10:09:33.889243 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Role: reader,member Jun 30 10:09:33.889243 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Roles: reader,member Jun 30 10:09:33.890949 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/315760a46046430780d7d4741cd8dc7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/315760a46046430780d7d4741cd8dc7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/315760a46046430780d7d4741cd8dc7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_315760a46046430780d7d4741cd8dc7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:09:33.890949 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-AttachVolumeTestJSON-1253618327 Jun 30 10:09:33.890949 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 315760a46046430780d7d4741cd8dc7f Jun 30 10:09:33.890949 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1253618327 Jun 30 10:09:33.890949 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User: tempest-AttachVolumeTestJSON-1253618327-project Jun 30 10:09:33.890949 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jun 30 10:09:33.890949 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jun 30 10:09:33.890949 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Id: 3593c14c5890431d8c4a986132a659b4 Jun 30 10:09:33.890949 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-AttachVolumeTestJSON-1253618327-project Jun 30 10:09:33.890949 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: method: > Jun 30 10:09:33.890949 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: exception: Instance 27789fd0-038a-4d0d-b26f-4b5f5c0d8685 could not be found. Jun 30 10:09:33.890949 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: action_args: {'id': '27789fd0-038a-4d0d-b26f-4b5f5c0d8685'} Jun 30 10:09:33.891838 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:09:33.891838 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:09:33.891838 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:09:33.891838 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:09:33.891838 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:09:33.891838 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:09:33.891838 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:09:33.891838 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:09:33.891838 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:09:33.891838 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:09:33.891838 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27789fd0-038a-4d0d-b26f-4b5f5c0d8685 could not be found. Jun 30 10:09:33.891838 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:09:33.891838 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:09:33.891838 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:09:33.891838 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:09:33.891838 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:09:33.891838 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:09:33.891838 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:09:33.891838 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:09:33.891838 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:09:33.893204 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:09:33.893204 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:09:33.893204 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:09:33.893204 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:09:33.893204 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:09:33.893204 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:09:33.893204 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:09:33.893204 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27789fd0-038a-4d0d-b26f-4b5f5c0d8685 could not be found. Jun 30 10:09:33.893204 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:09:33.893204 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:09:33.893204 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:09:33.893204 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:09:33.893204 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:09:33.893204 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:09:33.893204 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:09:33.893204 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:09:33.893204 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27789fd0-038a-4d0d-b26f-4b5f5c0d8685 could not be found. Jun 30 10:09:33.893204 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:09:33.894385 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-6f24bb38-3a68-4b82-abb2-f0e6698bd877 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Returning 404 to user: Instance 27789fd0-038a-4d0d-b26f-4b5f5c0d8685 could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:09:33.894385 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-6f24bb38-3a68-4b82-abb2-f0e6698bd877 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 404 len: 111 microversion: 2.1 time: 0.035094 Jun 30 10:09:33.894385 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 475/937] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:09:33 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:09:33.902207 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-ec73fe40-d2e4-4871-b27c-343cb0dcff74 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '.version_select at 0x7fc224bca8b0>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:09:33.925402 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-ec73fe40-d2e4-4871-b27c-343cb0dcff74 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1838167340" status: 202 len: 0 microversion: 2.1 time: 0.029038 Jun 30 10:09:33.925964 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 463/938] 10.222.0.16 () {58 vars in 1220 bytes} [Thu Jun 30 10:09:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1838167340 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:09:34.587633 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-8619c59b-8e65-440f-96c1-85c0f7cfc6db tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Action: 'create', calling method: .version_select at 0x7fc22037f310>, body: {"keypair": {"name": "tempest-keypair-748737555", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgFx0P5KF3U5yNu97i3+1kHxVTPf0wserRHyNWNN/VbNVNg4uClzuJltkHay/AUdL7PmrnBxa5X/3e9LloA9tUe+Uo8SF2pkl3oOo5xIdsiGwiOiS1gUfgSVfnlbCW6Wg=="}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:09:34.592161 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=4 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:34.604352 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-8619c59b-8e65-440f-96c1-85c0f7cfc6db tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Getting quotas for project 315760a46046430780d7d4741cd8dc7f. Resources: {'key_pairs'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:09:34.608392 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-8619c59b-8e65-440f-96c1-85c0f7cfc6db tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Getting quotas for user 3593c14c5890431d8c4a986132a659b4 and project 315760a46046430780d7d4741cd8dc7f. Resources: {'key_pairs'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:09:34.632846 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-8619c59b-8e65-440f-96c1-85c0f7cfc6db tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051708 Jun 30 10:09:34.634546 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 476/939] 10.222.0.16 () {60 vars in 1158 bytes} [Thu Jun 30 10:09:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:09:36.115579 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-e4d1c349-bfff-4f42-a976-a8db281d0e76 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-675537800", "imageRef": "c9dccba6-70d7-4aa8-9b8f-9c88ef1af443", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a532d829-2cb5-43c4-8d0b-23b50c2e25af"}], "security_groups": [{"name": "tempest-securitygroup--1706599401"}], "key_name": "tempest-keypair-748737555", "user_data": "}} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:09:36.227251 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.network.neutron [None req-e4d1c349-bfff-4f42-a976-a8db281d0e76 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] validate_networks() for [('a532d829-2cb5-43c4-8d0b-23b50c2e25af', None, None, None, None, None)] {{(pid=117847) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 10:09:36.610557 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-e4d1c349-bfff-4f42-a976-a8db281d0e76 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Flavor limits 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 10:09:36.611092 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-e4d1c349-bfff-4f42-a976-a8db281d0e76 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Image limits 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 10:09:36.611769 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-e4d1c349-bfff-4f42-a976-a8db281d0e76 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Flavor pref 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 10:09:36.612321 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-e4d1c349-bfff-4f42-a976-a8db281d0e76 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Image pref 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 10:09:36.612851 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-e4d1c349-bfff-4f42-a976-a8db281d0e76 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 10:09:36.624484 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e4d1c349-bfff-4f42-a976-a8db281d0e76 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:36.624923 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e4d1c349-bfff-4f42-a976-a8db281d0e76 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:36.625722 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e4d1c349-bfff-4f42-a976-a8db281d0e76 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:36.626156 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e4d1c349-bfff-4f42-a976-a8db281d0e76 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:36.642949 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.quota [None req-e4d1c349-bfff-4f42-a976-a8db281d0e76 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Getting quotas for project 315760a46046430780d7d4741cd8dc7f. Resources: {'ram', 'instances', 'cores'} {{(pid=117847) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:09:36.646949 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.quota [None req-e4d1c349-bfff-4f42-a976-a8db281d0e76 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Getting quotas for user 3593c14c5890431d8c4a986132a659b4 and project 315760a46046430780d7d4741cd8dc7f. Resources: {'ram', 'instances', 'cores'} {{(pid=117847) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:09:36.660418 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-e4d1c349-bfff-4f42-a976-a8db281d0e76 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Going to run 1 instances... {{(pid=117847) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 10:09:36.664120 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-e4d1c349-bfff-4f42-a976-a8db281d0e76 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 6517c445-5926-4e1c-b6b3-981513f7cea1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9dccba6-70d7-4aa8-9b8f-9c88ef1af443',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117847) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 10:09:36.718778 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-e4d1c349-bfff-4f42-a976-a8db281d0e76 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.608032 Jun 30 10:09:36.719586 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 464/940] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jun 30 10:09:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 10:09:36.730504 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e474c7fa-e5e9-427f-9fa0-db71c47f44e9 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:09:36.731110 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-e474c7fa-e5e9-427f-9fa0-db71c47f44e9 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 6517c445-5926-4e1c-b6b3-981513f7cea1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:09:36.786851 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e474c7fa-e5e9-427f-9fa0-db71c47f44e9 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:09:36.794248 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-e474c7fa-e5e9-427f-9fa0-db71c47f44e9 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1" status: 200 len: 1236 microversion: 2.1 time: 0.068512 Jun 30 10:09:36.794837 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 477/941] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:09:36 2022] GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1 => generated 1236 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:09:37.812441 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-03c66e83-9938-4580-a133-65d04448ebb4 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:09:37.813253 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-03c66e83-9938-4580-a133-65d04448ebb4 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 6517c445-5926-4e1c-b6b3-981513f7cea1] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:09:37.820515 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-03c66e83-9938-4580-a133-65d04448ebb4 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:37.820991 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-03c66e83-9938-4580-a133-65d04448ebb4 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:37.821752 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-03c66e83-9938-4580-a133-65d04448ebb4 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:37.822190 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-03c66e83-9938-4580-a133-65d04448ebb4 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:37.895372 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-03c66e83-9938-4580-a133-65d04448ebb4 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:09:37.904767 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-03c66e83-9938-4580-a133-65d04448ebb4 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1" status: 200 len: 1306 microversion: 2.1 time: 0.098197 Jun 30 10:09:37.905564 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 465/942] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:09:37 2022] GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1 => generated 1306 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:09:38.924310 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-0d4e9996-dd40-490d-aa48-51f9100ec0cb tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:09:38.925203 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-0d4e9996-dd40-490d-aa48-51f9100ec0cb tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 6517c445-5926-4e1c-b6b3-981513f7cea1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:09:38.932920 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0d4e9996-dd40-490d-aa48-51f9100ec0cb tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:38.933366 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0d4e9996-dd40-490d-aa48-51f9100ec0cb tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:38.934884 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0d4e9996-dd40-490d-aa48-51f9100ec0cb tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:38.935319 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0d4e9996-dd40-490d-aa48-51f9100ec0cb tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:39.188280 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-0d4e9996-dd40-490d-aa48-51f9100ec0cb tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:09:39.198547 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-0d4e9996-dd40-490d-aa48-51f9100ec0cb tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1" status: 200 len: 1362 microversion: 2.1 time: 0.280283 Jun 30 10:09:39.199586 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 478/943] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:09:38 2022] GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1 => generated 1362 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:09:39.411769 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [req-d48e785f-d7bd-4ce7-898f-c8e50a104c36 req-3b062874-fb04-4e7c-b1e0-95b962cde7d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6517c445-5926-4e1c-b6b3-981513f7cea1", "tag": "81931e61-4859-441b-a576-3e46849c8c57"}]} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:09:39.430105 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-d48e785f-d7bd-4ce7-898f-c8e50a104c36 req-3b062874-fb04-4e7c-b1e0-95b962cde7d0 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:39.430909 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-d48e785f-d7bd-4ce7-898f-c8e50a104c36 req-3b062874-fb04-4e7c-b1e0-95b962cde7d0 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:39.447066 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.compute.server_external_events [req-d48e785f-d7bd-4ce7-898f-c8e50a104c36 req-3b062874-fb04-4e7c-b1e0-95b962cde7d0 service nova] Creating event network-changed:81931e61-4859-441b-a576-3e46849c8c57 for instance 6517c445-5926-4e1c-b6b3-981513f7cea1 on hv-cinder-84330 Jun 30 10:09:39.454359 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [req-d48e785f-d7bd-4ce7-898f-c8e50a104c36 req-3b062874-fb04-4e7c-b1e0-95b962cde7d0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049214 Jun 30 10:09:39.454954 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 466/944] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:09:39.662834 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-0490fbb0-74fa-4c3a-8f63-272b975a3822 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1359233143", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1371658480", "security_groups": [{"name": "tempest-secgroup-smoke-774570719"}], "networks": [{"uuid": "5a617f26-3fc5-48e3-a903-e3f92a551f1a"}], "block_device_mapping_v2": [{"uuid": "3c3cabc3-3b56-4754-a74c-8498a08b638f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:09:39.827635 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.network.neutron [None req-0490fbb0-74fa-4c3a-8f63-272b975a3822 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] validate_networks() for [('5a617f26-3fc5-48e3-a903-e3f92a551f1a', None, None, None, None, None)] {{(pid=117846) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 10:09:40.217719 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-99542530-857c-43ab-8bef-f76014cbd0b8 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:09:40.218325 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-99542530-857c-43ab-8bef-f76014cbd0b8 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 6517c445-5926-4e1c-b6b3-981513f7cea1] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:09:40.225263 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-99542530-857c-43ab-8bef-f76014cbd0b8 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:40.225726 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-99542530-857c-43ab-8bef-f76014cbd0b8 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:40.226506 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-99542530-857c-43ab-8bef-f76014cbd0b8 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:40.226938 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-99542530-857c-43ab-8bef-f76014cbd0b8 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:40.253746 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-0490fbb0-74fa-4c3a-8f63-272b975a3822 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Flavor limits 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 10:09:40.254304 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-0490fbb0-74fa-4c3a-8f63-272b975a3822 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Image limits 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 10:09:40.254723 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-0490fbb0-74fa-4c3a-8f63-272b975a3822 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Flavor pref 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 10:09:40.255122 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-0490fbb0-74fa-4c3a-8f63-272b975a3822 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Image pref 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 10:09:40.255581 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-0490fbb0-74fa-4c3a-8f63-272b975a3822 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 10:09:40.264858 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0490fbb0-74fa-4c3a-8f63-272b975a3822 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:40.265291 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0490fbb0-74fa-4c3a-8f63-272b975a3822 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:40.266083 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0490fbb0-74fa-4c3a-8f63-272b975a3822 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:40.266513 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0490fbb0-74fa-4c3a-8f63-272b975a3822 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:40.284484 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-0490fbb0-74fa-4c3a-8f63-272b975a3822 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Getting quotas for project 84c9f15ea7b84f54a6cfa004bd02de6e. Resources: {'ram', 'instances', 'cores'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:09:40.288575 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-0490fbb0-74fa-4c3a-8f63-272b975a3822 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Getting quotas for user fbc71c372e584ddf91290eefb53a973a and project 84c9f15ea7b84f54a6cfa004bd02de6e. Resources: {'ram', 'instances', 'cores'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:09:40.347177 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-0490fbb0-74fa-4c3a-8f63-272b975a3822 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Going to run 1 instances... {{(pid=117846) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 10:09:40.349308 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-0490fbb0-74fa-4c3a-8f63-272b975a3822 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3c3cabc3-3b56-4754-a74c-8498a08b638f',volume_size=None,volume_type=None)] {{(pid=117846) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 10:09:40.366329 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-99542530-857c-43ab-8bef-f76014cbd0b8 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:09:40.380346 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-99542530-857c-43ab-8bef-f76014cbd0b8 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1" status: 200 len: 1362 microversion: 2.1 time: 0.167152 Jun 30 10:09:40.381312 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 467/945] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:09:40 2022] GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:09:40.486650 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-0490fbb0-74fa-4c3a-8f63-272b975a3822 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.827988 Jun 30 10:09:40.487896 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 479/946] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jun 30 10:09:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 10:09:40.497875 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-97bdc6d2-fa70-4282-8230-de005d6b42cf tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:09:40.498595 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-97bdc6d2-fa70-4282-8230-de005d6b42cf tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:09:40.551525 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-97bdc6d2-fa70-4282-8230-de005d6b42cf tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc71c372e584ddf91290eefb53a973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c9f15ea7b84f54a6cfa004bd02de6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:09:40.558981 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-97bdc6d2-fa70-4282-8230-de005d6b42cf tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f" status: 200 len: 1089 microversion: 2.1 time: 0.064949 Jun 30 10:09:40.559549 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 468/947] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:09:40 2022] GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f => generated 1089 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:09:41.398389 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-02477f2c-a277-4188-8549-a148d4a2e987 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:09:41.399051 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-02477f2c-a277-4188-8549-a148d4a2e987 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 6517c445-5926-4e1c-b6b3-981513f7cea1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:09:41.407792 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-02477f2c-a277-4188-8549-a148d4a2e987 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:41.408354 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-02477f2c-a277-4188-8549-a148d4a2e987 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:41.409217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-02477f2c-a277-4188-8549-a148d4a2e987 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:41.409703 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-02477f2c-a277-4188-8549-a148d4a2e987 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:41.577596 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-660ceb19-0078-40dc-a3a8-00ddb1c789f1 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:09:41.578445 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-660ceb19-0078-40dc-a3a8-00ddb1c789f1 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:09:41.586859 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-660ceb19-0078-40dc-a3a8-00ddb1c789f1 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:41.587427 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-660ceb19-0078-40dc-a3a8-00ddb1c789f1 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:41.588244 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-660ceb19-0078-40dc-a3a8-00ddb1c789f1 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:41.588818 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-660ceb19-0078-40dc-a3a8-00ddb1c789f1 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:41.644301 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-02477f2c-a277-4188-8549-a148d4a2e987 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:09:41.652688 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-02477f2c-a277-4188-8549-a148d4a2e987 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1" status: 200 len: 1362 microversion: 2.1 time: 0.259313 Jun 30 10:09:41.660221 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 480/948] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:09:41 2022] GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1 => generated 1362 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:09:41.668577 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-660ceb19-0078-40dc-a3a8-00ddb1c789f1 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc71c372e584ddf91290eefb53a973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c9f15ea7b84f54a6cfa004bd02de6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:09:41.682704 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-660ceb19-0078-40dc-a3a8-00ddb1c789f1 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f" status: 200 len: 1205 microversion: 2.1 time: 0.109431 Jun 30 10:09:41.683312 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 469/949] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:09:41 2022] GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f => generated 1205 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:09:42.670041 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-7a565577-f6c2-4895-9b29-776f3e5a259f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:09:42.670605 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-7a565577-f6c2-4895-9b29-776f3e5a259f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 6517c445-5926-4e1c-b6b3-981513f7cea1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:09:42.677389 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7a565577-f6c2-4895-9b29-776f3e5a259f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:42.677993 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7a565577-f6c2-4895-9b29-776f3e5a259f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:42.678754 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7a565577-f6c2-4895-9b29-776f3e5a259f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:42.679177 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7a565577-f6c2-4895-9b29-776f3e5a259f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:42.700353 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-ec069058-0699-409b-93e1-c80597b83b39 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:09:42.700912 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-ec069058-0699-409b-93e1-c80597b83b39 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:09:42.707952 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ec069058-0699-409b-93e1-c80597b83b39 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:42.708536 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ec069058-0699-409b-93e1-c80597b83b39 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:42.709516 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ec069058-0699-409b-93e1-c80597b83b39 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:42.709933 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ec069058-0699-409b-93e1-c80597b83b39 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:43.010653 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7a565577-f6c2-4895-9b29-776f3e5a259f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:09:43.017427 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-ec069058-0699-409b-93e1-c80597b83b39 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc71c372e584ddf91290eefb53a973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c9f15ea7b84f54a6cfa004bd02de6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:09:43.019498 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-7a565577-f6c2-4895-9b29-776f3e5a259f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1" status: 200 len: 1362 microversion: 2.1 time: 0.353483 Jun 30 10:09:43.020453 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 481/950] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:09:42 2022] GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1 => generated 1362 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:09:43.032683 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-ec069058-0699-409b-93e1-c80597b83b39 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f" status: 200 len: 1260 microversion: 2.1 time: 0.336070 Jun 30 10:09:43.033443 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 470/951] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:09:42 2022] GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f => generated 1260 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:09:43.171734 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-1df6c1d1-62d6-4cc7-b4b7-fc29d8e7dffe req-16c81e35-a94a-4a9c-b723-0bfe57791597 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0947fb10-14c6-4e0e-ad30-45bb44422c9f", "tag": "e7fe2382-c98a-487a-ad01-556028fac2e1"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:09:43.202897 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-1df6c1d1-62d6-4cc7-b4b7-fc29d8e7dffe req-16c81e35-a94a-4a9c-b723-0bfe57791597 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:43.203533 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-1df6c1d1-62d6-4cc7-b4b7-fc29d8e7dffe req-16c81e35-a94a-4a9c-b723-0bfe57791597 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:43.217892 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-1df6c1d1-62d6-4cc7-b4b7-fc29d8e7dffe req-16c81e35-a94a-4a9c-b723-0bfe57791597 service nova] Creating event network-changed:e7fe2382-c98a-487a-ad01-556028fac2e1 for instance 0947fb10-14c6-4e0e-ad30-45bb44422c9f on hv-cinder-84330 Jun 30 10:09:43.225880 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-1df6c1d1-62d6-4cc7-b4b7-fc29d8e7dffe req-16c81e35-a94a-4a9c-b723-0bfe57791597 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057631 Jun 30 10:09:43.227168 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 482/952] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:09:43.856584 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [req-2b47c49f-6c88-49c8-b6c6-b61cb866ed03 req-16182630-bdab-48ca-a4f5-80713b2078e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6517c445-5926-4e1c-b6b3-981513f7cea1", "name": "network-vif-plugged", "status": "completed", "tag": "81931e61-4859-441b-a576-3e46849c8c57"}]} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:09:43.867031 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-2b47c49f-6c88-49c8-b6c6-b61cb866ed03 req-16182630-bdab-48ca-a4f5-80713b2078e3 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:43.867856 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-2b47c49f-6c88-49c8-b6c6-b61cb866ed03 req-16182630-bdab-48ca-a4f5-80713b2078e3 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:43.880911 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.compute.server_external_events [req-2b47c49f-6c88-49c8-b6c6-b61cb866ed03 req-16182630-bdab-48ca-a4f5-80713b2078e3 service nova] Creating event network-vif-plugged:81931e61-4859-441b-a576-3e46849c8c57 for instance 6517c445-5926-4e1c-b6b3-981513f7cea1 on hv-cinder-84330 Jun 30 10:09:43.885894 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [req-2b47c49f-6c88-49c8-b6c6-b61cb866ed03 req-16182630-bdab-48ca-a4f5-80713b2078e3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033793 Jun 30 10:09:43.886695 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 471/953] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:09:44.037642 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-aa93c82c-afaf-4964-adb8-6dba2d229cdc tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:09:44.038335 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-aa93c82c-afaf-4964-adb8-6dba2d229cdc tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 6517c445-5926-4e1c-b6b3-981513f7cea1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:09:44.047234 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-aa93c82c-afaf-4964-adb8-6dba2d229cdc tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:44.047674 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-aa93c82c-afaf-4964-adb8-6dba2d229cdc tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:44.048498 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-aa93c82c-afaf-4964-adb8-6dba2d229cdc tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:44.048924 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-aa93c82c-afaf-4964-adb8-6dba2d229cdc tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:44.051763 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-9432969f-9bd0-4a45-a2c0-bacd01c9008b tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:09:44.052516 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-9432969f-9bd0-4a45-a2c0-bacd01c9008b tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:09:44.060540 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9432969f-9bd0-4a45-a2c0-bacd01c9008b tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:44.061034 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9432969f-9bd0-4a45-a2c0-bacd01c9008b tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:44.061810 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9432969f-9bd0-4a45-a2c0-bacd01c9008b tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:44.062245 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9432969f-9bd0-4a45-a2c0-bacd01c9008b tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:44.362490 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-aa93c82c-afaf-4964-adb8-6dba2d229cdc tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:09:44.370413 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-aa93c82c-afaf-4964-adb8-6dba2d229cdc tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1" status: 200 len: 1362 microversion: 2.1 time: 0.336995 Jun 30 10:09:44.371103 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 483/954] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:09:44 2022] GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1 => generated 1362 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:09:44.413642 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-9432969f-9bd0-4a45-a2c0-bacd01c9008b tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc71c372e584ddf91290eefb53a973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c9f15ea7b84f54a6cfa004bd02de6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:09:44.422477 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-9432969f-9bd0-4a45-a2c0-bacd01c9008b tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f" status: 200 len: 1260 microversion: 2.1 time: 0.375466 Jun 30 10:09:44.423150 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 472/955] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:09:44 2022] GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f => generated 1260 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:09:45.390901 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-7e702587-a184-4de7-a998-a8a7f2ca910c tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:09:45.391587 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-7e702587-a184-4de7-a998-a8a7f2ca910c tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 6517c445-5926-4e1c-b6b3-981513f7cea1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:09:45.398599 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7e702587-a184-4de7-a998-a8a7f2ca910c tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:45.399047 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7e702587-a184-4de7-a998-a8a7f2ca910c tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:45.399829 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7e702587-a184-4de7-a998-a8a7f2ca910c tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:45.400410 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7e702587-a184-4de7-a998-a8a7f2ca910c tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:45.439391 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-c9cdbd13-c629-4d01-b01d-7e873639d4e6 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:09:45.440135 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-c9cdbd13-c629-4d01-b01d-7e873639d4e6 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:09:45.447093 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c9cdbd13-c629-4d01-b01d-7e873639d4e6 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:45.447612 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c9cdbd13-c629-4d01-b01d-7e873639d4e6 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:45.448472 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c9cdbd13-c629-4d01-b01d-7e873639d4e6 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:45.448895 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c9cdbd13-c629-4d01-b01d-7e873639d4e6 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:45.580059 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7e702587-a184-4de7-a998-a8a7f2ca910c tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:09:45.588010 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-7e702587-a184-4de7-a998-a8a7f2ca910c tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1" status: 200 len: 1362 microversion: 2.1 time: 0.202474 Jun 30 10:09:45.588545 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 484/956] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:09:45 2022] GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1 => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:09:45.609220 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-c9cdbd13-c629-4d01-b01d-7e873639d4e6 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc71c372e584ddf91290eefb53a973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c9f15ea7b84f54a6cfa004bd02de6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:09:45.617225 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-c9cdbd13-c629-4d01-b01d-7e873639d4e6 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f" status: 200 len: 1260 microversion: 2.1 time: 0.181653 Jun 30 10:09:45.617756 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 473/957] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:09:45 2022] GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f => generated 1260 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:09:46.608219 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-18ec95b0-ff5b-4097-a2ea-586260110f5b tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:09:46.609254 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-18ec95b0-ff5b-4097-a2ea-586260110f5b tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 6517c445-5926-4e1c-b6b3-981513f7cea1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:09:46.620572 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-18ec95b0-ff5b-4097-a2ea-586260110f5b tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:46.621362 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-18ec95b0-ff5b-4097-a2ea-586260110f5b tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:46.622388 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-18ec95b0-ff5b-4097-a2ea-586260110f5b tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:46.622841 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-18ec95b0-ff5b-4097-a2ea-586260110f5b tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:46.634231 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-9c86ab25-c361-4e16-a2e2-fab69e0bf582 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:09:46.634828 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-9c86ab25-c361-4e16-a2e2-fab69e0bf582 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:09:46.637482 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell0:SELECT=2 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:46.643148 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9c86ab25-c361-4e16-a2e2-fab69e0bf582 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:46.643588 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9c86ab25-c361-4e16-a2e2-fab69e0bf582 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:46.644385 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9c86ab25-c361-4e16-a2e2-fab69e0bf582 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:46.644813 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9c86ab25-c361-4e16-a2e2-fab69e0bf582 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:46.840014 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-18ec95b0-ff5b-4097-a2ea-586260110f5b tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:09:46.844630 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-9c86ab25-c361-4e16-a2e2-fab69e0bf582 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc71c372e584ddf91290eefb53a973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c9f15ea7b84f54a6cfa004bd02de6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:09:46.848646 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-18ec95b0-ff5b-4097-a2ea-586260110f5b tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1" status: 200 len: 1549 microversion: 2.1 time: 0.246838 Jun 30 10:09:46.849229 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 485/958] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:09:46 2022] GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1 => generated 1549 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:09:46.853164 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-9c86ab25-c361-4e16-a2e2-fab69e0bf582 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f" status: 200 len: 1260 microversion: 2.1 time: 0.222810 Jun 30 10:09:46.853720 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 474/959] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:09:46 2022] GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f => generated 1260 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:09:46.864663 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-0a7ef183-b54f-4f75-9edb-29d036319a74 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:09:46.865100 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-0a7ef183-b54f-4f75-9edb-29d036319a74 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 6517c445-5926-4e1c-b6b3-981513f7cea1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:09:46.871466 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0a7ef183-b54f-4f75-9edb-29d036319a74 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:46.872039 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0a7ef183-b54f-4f75-9edb-29d036319a74 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:46.873051 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0a7ef183-b54f-4f75-9edb-29d036319a74 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:46.873481 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0a7ef183-b54f-4f75-9edb-29d036319a74 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:46.969788 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-0a7ef183-b54f-4f75-9edb-29d036319a74 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.108581 Jun 30 10:09:46.970670 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 486/960] 10.222.0.16 () {58 vars in 1274 bytes} [Thu Jun 30 10:09:46 2022] GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:09:47.869889 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-6504960d-cddb-4753-86a0-e5cbc3427b80 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:09:47.870519 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-6504960d-cddb-4753-86a0-e5cbc3427b80 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:09:47.878642 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-6504960d-cddb-4753-86a0-e5cbc3427b80 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:47.879087 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-6504960d-cddb-4753-86a0-e5cbc3427b80 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:47.879861 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-6504960d-cddb-4753-86a0-e5cbc3427b80 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:47.880326 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-6504960d-cddb-4753-86a0-e5cbc3427b80 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:48.233345 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-c9d214df-d1bd-4806-a185-8c10731cf5d4 req-5c6d0d41-b99c-4d5d-b2b6-242330767c5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6517c445-5926-4e1c-b6b3-981513f7cea1", "tag": "81931e61-4859-441b-a576-3e46849c8c57"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:09:48.234870 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-6504960d-cddb-4753-86a0-e5cbc3427b80 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc71c372e584ddf91290eefb53a973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c9f15ea7b84f54a6cfa004bd02de6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:09:48.241842 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-c9d214df-d1bd-4806-a185-8c10731cf5d4 req-5c6d0d41-b99c-4d5d-b2b6-242330767c5a service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:48.242404 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-c9d214df-d1bd-4806-a185-8c10731cf5d4 req-5c6d0d41-b99c-4d5d-b2b6-242330767c5a service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:48.243042 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-6504960d-cddb-4753-86a0-e5cbc3427b80 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f" status: 200 len: 1260 microversion: 2.1 time: 0.377187 Jun 30 10:09:48.243616 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 475/961] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:09:47 2022] GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f => generated 1260 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:09:48.254690 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-c9d214df-d1bd-4806-a185-8c10731cf5d4 req-5c6d0d41-b99c-4d5d-b2b6-242330767c5a service nova] Creating event network-changed:81931e61-4859-441b-a576-3e46849c8c57 for instance 6517c445-5926-4e1c-b6b3-981513f7cea1 on hv-cinder-84330 Jun 30 10:09:48.259888 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-c9d214df-d1bd-4806-a185-8c10731cf5d4 req-5c6d0d41-b99c-4d5d-b2b6-242330767c5a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030927 Jun 30 10:09:48.260596 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 487/962] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:09:49.260101 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-d2c4f3f0-1eaf-4774-a106-3ef6fdd38633 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:09:49.260702 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-d2c4f3f0-1eaf-4774-a106-3ef6fdd38633 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:09:49.267401 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d2c4f3f0-1eaf-4774-a106-3ef6fdd38633 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:49.267840 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d2c4f3f0-1eaf-4774-a106-3ef6fdd38633 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:49.268624 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d2c4f3f0-1eaf-4774-a106-3ef6fdd38633 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:49.269051 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-d2c4f3f0-1eaf-4774-a106-3ef6fdd38633 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:49.415224 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-d2c4f3f0-1eaf-4774-a106-3ef6fdd38633 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc71c372e584ddf91290eefb53a973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c9f15ea7b84f54a6cfa004bd02de6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:09:49.423060 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-d2c4f3f0-1eaf-4774-a106-3ef6fdd38633 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f" status: 200 len: 1260 microversion: 2.1 time: 0.166897 Jun 30 10:09:49.423598 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 476/963] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:09:49 2022] GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:09:50.446746 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-a17d4d4f-91b0-4120-91d7-1f3931367951 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:09:50.449033 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-a17d4d4f-91b0-4120-91d7-1f3931367951 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:09:50.454280 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=2 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:50.454958 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=12 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:50.461699 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a17d4d4f-91b0-4120-91d7-1f3931367951 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:50.462138 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a17d4d4f-91b0-4120-91d7-1f3931367951 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:50.462889 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a17d4d4f-91b0-4120-91d7-1f3931367951 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:50.463313 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a17d4d4f-91b0-4120-91d7-1f3931367951 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:50.610994 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-a17d4d4f-91b0-4120-91d7-1f3931367951 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc71c372e584ddf91290eefb53a973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c9f15ea7b84f54a6cfa004bd02de6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:09:50.619041 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-a17d4d4f-91b0-4120-91d7-1f3931367951 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f" status: 200 len: 1260 microversion: 2.1 time: 0.180937 Jun 30 10:09:50.619599 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 488/964] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:09:50 2022] GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f => generated 1260 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:09:51.636211 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-e001350d-4d5b-47f4-9679-38f73d95e789 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:09:51.636812 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-e001350d-4d5b-47f4-9679-38f73d95e789 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:09:51.639179 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell0:SELECT=8 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:51.645058 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e001350d-4d5b-47f4-9679-38f73d95e789 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:51.645495 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e001350d-4d5b-47f4-9679-38f73d95e789 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:51.646240 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e001350d-4d5b-47f4-9679-38f73d95e789 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:51.646663 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e001350d-4d5b-47f4-9679-38f73d95e789 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:51.785858 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-e001350d-4d5b-47f4-9679-38f73d95e789 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc71c372e584ddf91290eefb53a973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c9f15ea7b84f54a6cfa004bd02de6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:09:51.794329 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-e001350d-4d5b-47f4-9679-38f73d95e789 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f" status: 200 len: 1260 microversion: 2.1 time: 0.162096 Jun 30 10:09:51.794987 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 477/965] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:09:51 2022] GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:09:52.812885 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-271b3bb3-0c0c-4131-9390-6ca938ede2aa tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:09:52.813528 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-271b3bb3-0c0c-4131-9390-6ca938ede2aa tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:09:52.823698 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-271b3bb3-0c0c-4131-9390-6ca938ede2aa tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:52.824370 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-271b3bb3-0c0c-4131-9390-6ca938ede2aa tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:52.825477 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-271b3bb3-0c0c-4131-9390-6ca938ede2aa tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:52.825945 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-271b3bb3-0c0c-4131-9390-6ca938ede2aa tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:52.964355 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-271b3bb3-0c0c-4131-9390-6ca938ede2aa tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc71c372e584ddf91290eefb53a973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c9f15ea7b84f54a6cfa004bd02de6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:09:52.972609 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-271b3bb3-0c0c-4131-9390-6ca938ede2aa tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f" status: 200 len: 1260 microversion: 2.1 time: 0.163926 Jun 30 10:09:52.973215 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 489/966] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:09:52 2022] GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:09:53.987506 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [req-6e048b4c-fd72-4e8b-8035-0aabfb23e38d req-3d19a212-36bc-4361-9dd8-002f1ad818bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0947fb10-14c6-4e0e-ad30-45bb44422c9f", "name": "network-vif-plugged", "status": "completed", "tag": "e7fe2382-c98a-487a-ad01-556028fac2e1"}]} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:09:53.988805 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-9f136cb3-5d19-49b4-85ce-1008376af14f tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:09:53.989324 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-9f136cb3-5d19-49b4-85ce-1008376af14f tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:09:53.996599 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-6e048b4c-fd72-4e8b-8035-0aabfb23e38d req-3d19a212-36bc-4361-9dd8-002f1ad818bf service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:53.996774 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9f136cb3-5d19-49b4-85ce-1008376af14f tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:53.997154 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9f136cb3-5d19-49b4-85ce-1008376af14f tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:53.997646 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-6e048b4c-fd72-4e8b-8035-0aabfb23e38d req-3d19a212-36bc-4361-9dd8-002f1ad818bf service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:53.998044 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9f136cb3-5d19-49b4-85ce-1008376af14f tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:53.998588 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9f136cb3-5d19-49b4-85ce-1008376af14f tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:54.015322 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.compute.server_external_events [req-6e048b4c-fd72-4e8b-8035-0aabfb23e38d req-3d19a212-36bc-4361-9dd8-002f1ad818bf service nova] Creating event network-vif-plugged:e7fe2382-c98a-487a-ad01-556028fac2e1 for instance 0947fb10-14c6-4e0e-ad30-45bb44422c9f on hv-cinder-84330 Jun 30 10:09:54.020673 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [req-6e048b4c-fd72-4e8b-8035-0aabfb23e38d req-3d19a212-36bc-4361-9dd8-002f1ad818bf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037712 Jun 30 10:09:54.021936 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 478/967] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:09:54.139000 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-9f136cb3-5d19-49b4-85ce-1008376af14f tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc71c372e584ddf91290eefb53a973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c9f15ea7b84f54a6cfa004bd02de6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:09:54.141519 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:54.148666 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-9f136cb3-5d19-49b4-85ce-1008376af14f tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f" status: 200 len: 1260 microversion: 2.1 time: 0.163779 Jun 30 10:09:54.149250 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 490/968] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:09:53 2022] GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:09:55.171282 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-159a7f51-f907-4fac-91de-3482619916ee tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:09:55.171956 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-159a7f51-f907-4fac-91de-3482619916ee tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:09:55.179169 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-159a7f51-f907-4fac-91de-3482619916ee tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:55.179615 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-159a7f51-f907-4fac-91de-3482619916ee tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:55.180409 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-159a7f51-f907-4fac-91de-3482619916ee tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:55.180834 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-159a7f51-f907-4fac-91de-3482619916ee tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:55.333969 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-159a7f51-f907-4fac-91de-3482619916ee tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc71c372e584ddf91290eefb53a973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c9f15ea7b84f54a6cfa004bd02de6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:09:55.337613 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell1:SELECT=100 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:55.342805 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-159a7f51-f907-4fac-91de-3482619916ee tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f" status: 200 len: 1260 microversion: 2.1 time: 0.179281 Jun 30 10:09:55.343459 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 479/969] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:09:55 2022] GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:09:56.360308 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-0c56b20d-784a-4c1f-8b75-6f20b644e53f tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:09:56.360921 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-0c56b20d-784a-4c1f-8b75-6f20b644e53f tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:09:56.363569 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:56.369714 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0c56b20d-784a-4c1f-8b75-6f20b644e53f tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:56.370158 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0c56b20d-784a-4c1f-8b75-6f20b644e53f tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:56.370930 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0c56b20d-784a-4c1f-8b75-6f20b644e53f tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:56.371361 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0c56b20d-784a-4c1f-8b75-6f20b644e53f tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:56.511696 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-0c56b20d-784a-4c1f-8b75-6f20b644e53f tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc71c372e584ddf91290eefb53a973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c9f15ea7b84f54a6cfa004bd02de6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:09:56.520088 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-0c56b20d-784a-4c1f-8b75-6f20b644e53f tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f" status: 200 len: 1444 microversion: 2.1 time: 0.163900 Jun 30 10:09:56.520664 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 491/970] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:09:56 2022] GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f => generated 1444 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:09:56.540857 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-29d4825a-6f33-4c8d-9a25-205285bae1d5 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:09:56.541536 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-29d4825a-6f33-4c8d-9a25-205285bae1d5 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:09:56.550424 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-29d4825a-6f33-4c8d-9a25-205285bae1d5 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:56.550805 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-29d4825a-6f33-4c8d-9a25-205285bae1d5 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:56.551556 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-29d4825a-6f33-4c8d-9a25-205285bae1d5 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:56.552043 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-29d4825a-6f33-4c8d-9a25-205285bae1d5 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:56.696967 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-29d4825a-6f33-4c8d-9a25-205285bae1d5 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc71c372e584ddf91290eefb53a973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c9f15ea7b84f54a6cfa004bd02de6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:09:56.705121 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-29d4825a-6f33-4c8d-9a25-205285bae1d5 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f" status: 200 len: 1444 microversion: 2.1 time: 0.171841 Jun 30 10:09:56.705686 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 480/971] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:09:56 2022] GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f => generated 1444 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:09:58.487973 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-c8a415dd-dc15-4e24-87c4-ae927132f4d3 req-e55077ed-f4d4-4999-b76a-b174e215163f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0947fb10-14c6-4e0e-ad30-45bb44422c9f", "tag": "e7fe2382-c98a-487a-ad01-556028fac2e1"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:09:58.496773 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-c8a415dd-dc15-4e24-87c4-ae927132f4d3 req-e55077ed-f4d4-4999-b76a-b174e215163f service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:09:58.497558 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-c8a415dd-dc15-4e24-87c4-ae927132f4d3 req-e55077ed-f4d4-4999-b76a-b174e215163f service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:09:58.508698 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-c8a415dd-dc15-4e24-87c4-ae927132f4d3 req-e55077ed-f4d4-4999-b76a-b174e215163f service nova] Creating event network-changed:e7fe2382-c98a-487a-ad01-556028fac2e1 for instance 0947fb10-14c6-4e0e-ad30-45bb44422c9f on hv-cinder-84330 Jun 30 10:09:58.513912 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-c8a415dd-dc15-4e24-87c4-ae927132f4d3 req-e55077ed-f4d4-4999-b76a-b174e215163f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029812 Jun 30 10:09:58.514910 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 492/972] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:10:23.138942 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-945b56a2-b207-4b6b-96da-672501b033aa tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:10:23.139946 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-945b56a2-b207-4b6b-96da-672501b033aa tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 6517c445-5926-4e1c-b6b3-981513f7cea1] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:10:23.142244 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:23.142938 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell1:SELECT=6 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:23.149180 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-945b56a2-b207-4b6b-96da-672501b033aa tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:23.149619 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-945b56a2-b207-4b6b-96da-672501b033aa tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:23.150380 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-945b56a2-b207-4b6b-96da-672501b033aa tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:23.150812 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-945b56a2-b207-4b6b-96da-672501b033aa tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:23.177155 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-945b56a2-b207-4b6b-96da-672501b033aa tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1/ips" status: 200 len: 146 microversion: 2.1 time: 0.044686 Jun 30 10:10:23.178017 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 481/973] 10.222.0.16 () {58 vars in 1247 bytes} [Thu Jun 30 10:10:23 2022] GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1/ips => generated 146 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:10:24.515939 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=3 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:24.516776 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=9 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:24.521100 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-8f2dfe94-e3c6-450e-a615-24c9309a2ebc tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "070e5000-8c83-49b7-bc0f-672bf0b1e96a"}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:10:24.522237 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-8f2dfe94-e3c6-450e-a615-24c9309a2ebc tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 6517c445-5926-4e1c-b6b3-981513f7cea1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:10:24.529288 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8f2dfe94-e3c6-450e-a615-24c9309a2ebc tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:24.529762 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8f2dfe94-e3c6-450e-a615-24c9309a2ebc tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:24.530529 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8f2dfe94-e3c6-450e-a615-24c9309a2ebc tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:24.530984 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8f2dfe94-e3c6-450e-a615-24c9309a2ebc tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:24.908493 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-8f2dfe94-e3c6-450e-a615-24c9309a2ebc tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "POST /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.393910 Jun 30 10:10:24.911902 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 493/974] 10.222.0.16 () {60 vars in 1322 bytes} [Thu Jun 30 10:10:24 2022] POST /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1/os-volume_attachments => generated 194 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:10:31.383798 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-37b2d352-4a63-4c49-b509-dbc0070131d8 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:10:31.384811 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-37b2d352-4a63-4c49-b509-dbc0070131d8 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 6517c445-5926-4e1c-b6b3-981513f7cea1] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:10:31.391085 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-37b2d352-4a63-4c49-b509-dbc0070131d8 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:31.391538 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-37b2d352-4a63-4c49-b509-dbc0070131d8 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:31.392322 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-37b2d352-4a63-4c49-b509-dbc0070131d8 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:31.392750 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-37b2d352-4a63-4c49-b509-dbc0070131d8 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:31.422206 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-37b2d352-4a63-4c49-b509-dbc0070131d8 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042344 Jun 30 10:10:31.422673 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 482/975] 10.222.0.16 () {58 vars in 1301 bytes} [Thu Jun 30 10:10:31 2022] GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:10:31.439958 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-59f80511-8775-4eb1-99a6-f0318980b9d2 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:10:31.440543 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-59f80511-8775-4eb1-99a6-f0318980b9d2 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 6517c445-5926-4e1c-b6b3-981513f7cea1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:10:31.450207 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-59f80511-8775-4eb1-99a6-f0318980b9d2 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:31.450969 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-59f80511-8775-4eb1-99a6-f0318980b9d2 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:31.452138 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-59f80511-8775-4eb1-99a6-f0318980b9d2 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:31.452552 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-59f80511-8775-4eb1-99a6-f0318980b9d2 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:31.480351 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-59f80511-8775-4eb1-99a6-f0318980b9d2 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1/os-volume_attachments/070e5000-8c83-49b7-bc0f-672bf0b1e96a" status: 200 len: 194 microversion: 2.1 time: 0.048241 Jun 30 10:10:31.480911 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 494/976] 10.222.0.16 () {58 vars in 1412 bytes} [Thu Jun 30 10:10:31 2022] GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1/os-volume_attachments/070e5000-8c83-49b7-bc0f-672bf0b1e96a => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:10:32.828980 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-bda89f8a-d7e8-4333-a302-16d7aff51497 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9d6c5d9-fbbe-431a-8e04-75fc261ce69b"}} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:10:32.830053 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-bda89f8a-d7e8-4333-a302-16d7aff51497 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 6517c445-5926-4e1c-b6b3-981513f7cea1] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:10:32.837026 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-bda89f8a-d7e8-4333-a302-16d7aff51497 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:32.837482 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-bda89f8a-d7e8-4333-a302-16d7aff51497 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:32.838249 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-bda89f8a-d7e8-4333-a302-16d7aff51497 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:32.838687 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-bda89f8a-d7e8-4333-a302-16d7aff51497 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:33.168004 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-bda89f8a-d7e8-4333-a302-16d7aff51497 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "POST /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.342905 Jun 30 10:10:33.168614 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 483/977] 10.222.0.16 () {60 vars in 1322 bytes} [Thu Jun 30 10:10:32 2022] POST /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1/os-volume_attachments => generated 194 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:10:40.716003 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-0772b38e-f485-414d-8bfb-45cf52c11fbe tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:10:40.717232 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-0772b38e-f485-414d-8bfb-45cf52c11fbe tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 6517c445-5926-4e1c-b6b3-981513f7cea1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:10:40.724170 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0772b38e-f485-414d-8bfb-45cf52c11fbe tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:40.724613 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0772b38e-f485-414d-8bfb-45cf52c11fbe tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:40.725362 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0772b38e-f485-414d-8bfb-45cf52c11fbe tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:40.725787 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0772b38e-f485-414d-8bfb-45cf52c11fbe tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:40.755119 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-0772b38e-f485-414d-8bfb-45cf52c11fbe tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043144 Jun 30 10:10:40.755672 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 495/978] 10.222.0.16 () {58 vars in 1301 bytes} [Thu Jun 30 10:10:40 2022] GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:10:40.913923 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-a271c7ee-c492-4a1d-bd0b-aa6a509f651b tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:10:40.914561 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-a271c7ee-c492-4a1d-bd0b-aa6a509f651b tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 6517c445-5926-4e1c-b6b3-981513f7cea1] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:10:40.923010 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a271c7ee-c492-4a1d-bd0b-aa6a509f651b tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:40.923548 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a271c7ee-c492-4a1d-bd0b-aa6a509f651b tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:40.924494 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a271c7ee-c492-4a1d-bd0b-aa6a509f651b tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:40.925030 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a271c7ee-c492-4a1d-bd0b-aa6a509f651b tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:40.960142 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-a271c7ee-c492-4a1d-bd0b-aa6a509f651b tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1/os-volume_attachments/070e5000-8c83-49b7-bc0f-672bf0b1e96a" status: 200 len: 194 microversion: 2.1 time: 0.051473 Jun 30 10:10:40.960789 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 484/979] 10.222.0.16 () {58 vars in 1412 bytes} [Thu Jun 30 10:10:40 2022] GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1/os-volume_attachments/070e5000-8c83-49b7-bc0f-672bf0b1e96a => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:10:40.973871 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-2f0a08dd-7fa7-42d6-a1df-20faac9901b3 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:10:40.974836 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-2f0a08dd-7fa7-42d6-a1df-20faac9901b3 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 6517c445-5926-4e1c-b6b3-981513f7cea1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:10:40.988738 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2f0a08dd-7fa7-42d6-a1df-20faac9901b3 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:40.989525 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2f0a08dd-7fa7-42d6-a1df-20faac9901b3 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:40.990492 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2f0a08dd-7fa7-42d6-a1df-20faac9901b3 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:40.991167 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2f0a08dd-7fa7-42d6-a1df-20faac9901b3 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:41.083422 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.objects.instance [None req-2f0a08dd-7fa7-42d6-a1df-20faac9901b3 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lazy-loading 'services' on Instance uuid 6517c445-5926-4e1c-b6b3-981513f7cea1 {{(pid=117846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:10:41.161423 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-2f0a08dd-7fa7-42d6-a1df-20faac9901b3 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1/os-volume_attachments/070e5000-8c83-49b7-bc0f-672bf0b1e96a" status: 202 len: 0 microversion: 2.1 time: 0.194033 Jun 30 10:10:41.161963 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 496/980] 10.222.0.16 () {58 vars in 1415 bytes} [Thu Jun 30 10:10:40 2022] DELETE /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1/os-volume_attachments/070e5000-8c83-49b7-bc0f-672bf0b1e96a => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:10:41.922291 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-1588aa5c-23a3-4cad-aadc-609b57036402 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-918937877", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-121302753", "security_groups": [{"name": "tempest-secgroup-smoke-532297396"}], "block_device_mapping_v2": [{"uuid": "6794bc5c-f526-4ba4-a459-2e4e08f137f6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2b00bb97-ebc4-4ba6-81b4-d993140665ad"}]}} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:10:42.045073 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.network.neutron [None req-1588aa5c-23a3-4cad-aadc-609b57036402 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] validate_networks() for [('2b00bb97-ebc4-4ba6-81b4-d993140665ad', None, None, None, None, None)] {{(pid=117847) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 10:10:42.282334 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-3fba7f80-c4b8-4bb2-a8bf-af444aa98b6f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:10:42.282893 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-3fba7f80-c4b8-4bb2-a8bf-af444aa98b6f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 6517c445-5926-4e1c-b6b3-981513f7cea1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:10:42.289891 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3fba7f80-c4b8-4bb2-a8bf-af444aa98b6f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:42.290329 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3fba7f80-c4b8-4bb2-a8bf-af444aa98b6f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:42.291057 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3fba7f80-c4b8-4bb2-a8bf-af444aa98b6f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:42.291472 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3fba7f80-c4b8-4bb2-a8bf-af444aa98b6f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:42.321045 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-3fba7f80-c4b8-4bb2-a8bf-af444aa98b6f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1/os-volume_attachments/f9d6c5d9-fbbe-431a-8e04-75fc261ce69b" status: 200 len: 194 microversion: 2.1 time: 0.043806 Jun 30 10:10:42.321644 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 497/981] 10.222.0.16 () {58 vars in 1412 bytes} [Thu Jun 30 10:10:42 2022] GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1/os-volume_attachments/f9d6c5d9-fbbe-431a-8e04-75fc261ce69b => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:10:42.331446 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e0ec7167-1119-47b3-a848-1dea81a95750 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:10:42.331919 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-e0ec7167-1119-47b3-a848-1dea81a95750 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 6517c445-5926-4e1c-b6b3-981513f7cea1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:10:42.337879 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e0ec7167-1119-47b3-a848-1dea81a95750 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:42.338321 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e0ec7167-1119-47b3-a848-1dea81a95750 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:42.339037 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e0ec7167-1119-47b3-a848-1dea81a95750 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:42.341520 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e0ec7167-1119-47b3-a848-1dea81a95750 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:42.424003 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.objects.instance [None req-e0ec7167-1119-47b3-a848-1dea81a95750 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lazy-loading 'services' on Instance uuid 6517c445-5926-4e1c-b6b3-981513f7cea1 {{(pid=117846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:10:42.435032 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-1588aa5c-23a3-4cad-aadc-609b57036402 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Flavor limits 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 10:10:42.435448 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-1588aa5c-23a3-4cad-aadc-609b57036402 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Image limits 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 10:10:42.435906 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-1588aa5c-23a3-4cad-aadc-609b57036402 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Flavor pref 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 10:10:42.436329 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-1588aa5c-23a3-4cad-aadc-609b57036402 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Image pref 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 10:10:42.436850 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-1588aa5c-23a3-4cad-aadc-609b57036402 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 10:10:42.446153 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1588aa5c-23a3-4cad-aadc-609b57036402 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:42.446601 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1588aa5c-23a3-4cad-aadc-609b57036402 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:42.447391 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1588aa5c-23a3-4cad-aadc-609b57036402 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:42.447819 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1588aa5c-23a3-4cad-aadc-609b57036402 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:42.464743 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.quota [None req-1588aa5c-23a3-4cad-aadc-609b57036402 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Getting quotas for project 108ee256fba04d1b83fe00c166742f0b. Resources: {'ram', 'instances', 'cores'} {{(pid=117847) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:10:42.468755 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.quota [None req-1588aa5c-23a3-4cad-aadc-609b57036402 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Getting quotas for user ead8ee09f8514e75882c877042764a92 and project 108ee256fba04d1b83fe00c166742f0b. Resources: {'ram', 'instances', 'cores'} {{(pid=117847) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:10:42.504713 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-e0ec7167-1119-47b3-a848-1dea81a95750 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1/os-volume_attachments/f9d6c5d9-fbbe-431a-8e04-75fc261ce69b" status: 202 len: 0 microversion: 2.1 time: 0.176820 Jun 30 10:10:42.505528 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 498/982] 10.222.0.16 () {58 vars in 1415 bytes} [Thu Jun 30 10:10:42 2022] DELETE /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1/os-volume_attachments/f9d6c5d9-fbbe-431a-8e04-75fc261ce69b => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 30 10:10:42.531073 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-1588aa5c-23a3-4cad-aadc-609b57036402 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Going to run 1 instances... {{(pid=117847) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 10:10:42.533260 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-1588aa5c-23a3-4cad-aadc-609b57036402 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 2283b227-4655-4c28-9ceb-e725ac71fcb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6794bc5c-f526-4ba4-a459-2e4e08f137f6',volume_size=None,volume_type=None)] {{(pid=117847) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 10:10:42.664608 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-1588aa5c-23a3-4cad-aadc-609b57036402 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.746114 Jun 30 10:10:42.665250 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 485/983] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jun 30 10:10:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 10:10:42.675933 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-fc3538a9-78a2-43b0-bcce-51ce6caf186a tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:10:42.676707 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-fc3538a9-78a2-43b0-bcce-51ce6caf186a tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 2283b227-4655-4c28-9ceb-e725ac71fcb9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:10:42.731230 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-fc3538a9-78a2-43b0-bcce-51ce6caf186a tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:10:42.738304 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-fc3538a9-78a2-43b0-bcce-51ce6caf186a tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/2283b227-4655-4c28-9ceb-e725ac71fcb9" status: 200 len: 1093 microversion: 2.1 time: 0.066601 Jun 30 10:10:42.738871 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 499/984] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:10:42 2022] GET /compute/v2.1/servers/2283b227-4655-4c28-9ceb-e725ac71fcb9 => generated 1093 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:10:43.684278 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-936ffd6e-a373-44dc-89ed-6979e11ddb5d tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:10:43.685360 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-936ffd6e-a373-44dc-89ed-6979e11ddb5d tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 6517c445-5926-4e1c-b6b3-981513f7cea1] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:10:43.695148 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-936ffd6e-a373-44dc-89ed-6979e11ddb5d tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:43.695598 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-936ffd6e-a373-44dc-89ed-6979e11ddb5d tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:43.696388 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-936ffd6e-a373-44dc-89ed-6979e11ddb5d tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:43.696851 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-936ffd6e-a373-44dc-89ed-6979e11ddb5d tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:43.726557 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-936ffd6e-a373-44dc-89ed-6979e11ddb5d tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046535 Jun 30 10:10:43.727104 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 486/985] 10.222.0.16 () {58 vars in 1301 bytes} [Thu Jun 30 10:10:43 2022] GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 10:10:43.754558 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-88e4afd3-d062-42b2-adaf-1c6c28f92454 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:10:43.755154 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-88e4afd3-d062-42b2-adaf-1c6c28f92454 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 2283b227-4655-4c28-9ceb-e725ac71fcb9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:10:43.762910 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-88e4afd3-d062-42b2-adaf-1c6c28f92454 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:43.764043 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-88e4afd3-d062-42b2-adaf-1c6c28f92454 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:43.765027 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-88e4afd3-d062-42b2-adaf-1c6c28f92454 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:43.765670 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-88e4afd3-d062-42b2-adaf-1c6c28f92454 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:43.839514 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-05496ab4-09d2-4c74-8e8e-8a671c194606 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:10:43.840470 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-05496ab4-09d2-4c74-8e8e-8a671c194606 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 6517c445-5926-4e1c-b6b3-981513f7cea1] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:10:43.846716 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-05496ab4-09d2-4c74-8e8e-8a671c194606 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:43.847152 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-05496ab4-09d2-4c74-8e8e-8a671c194606 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:43.847930 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-05496ab4-09d2-4c74-8e8e-8a671c194606 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:43.848360 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-05496ab4-09d2-4c74-8e8e-8a671c194606 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:43.862172 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-88e4afd3-d062-42b2-adaf-1c6c28f92454 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:10:43.870820 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-88e4afd3-d062-42b2-adaf-1c6c28f92454 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/2283b227-4655-4c28-9ceb-e725ac71fcb9" status: 200 len: 1209 microversion: 2.1 time: 0.120094 Jun 30 10:10:43.871395 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 500/986] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:10:43 2022] GET /compute/v2.1/servers/2283b227-4655-4c28-9ceb-e725ac71fcb9 => generated 1209 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:10:43.877672 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-05496ab4-09d2-4c74-8e8e-8a671c194606 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042071 Jun 30 10:10:43.878223 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 487/987] 10.222.0.16 () {58 vars in 1301 bytes} [Thu Jun 30 10:10:43 2022] GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 30 10:10:43.936352 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-8acea694-4252-4d45-85b1-74028e1e6cba tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:10:43.936849 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-8acea694-4252-4d45-85b1-74028e1e6cba tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 6517c445-5926-4e1c-b6b3-981513f7cea1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:10:43.943262 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8acea694-4252-4d45-85b1-74028e1e6cba tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:43.943711 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8acea694-4252-4d45-85b1-74028e1e6cba tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:43.944625 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8acea694-4252-4d45-85b1-74028e1e6cba tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:43.945060 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8acea694-4252-4d45-85b1-74028e1e6cba tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:43.971853 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-8acea694-4252-4d45-85b1-74028e1e6cba tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 6517c445-5926-4e1c-b6b3-981513f7cea1] Going to try to terminate instance {{(pid=117846) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 10:10:44.064911 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-8acea694-4252-4d45-85b1-74028e1e6cba tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1" status: 204 len: 0 microversion: 2.1 time: 0.132283 Jun 30 10:10:44.065656 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 501/988] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 10:10:43 2022] DELETE /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 10:10:44.077375 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-a43222f2-ff3f-42cf-a093-50a79b1b5439 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:10:44.078523 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-a43222f2-ff3f-42cf-a093-50a79b1b5439 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 6517c445-5926-4e1c-b6b3-981513f7cea1] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:10:44.084968 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a43222f2-ff3f-42cf-a093-50a79b1b5439 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:44.085412 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a43222f2-ff3f-42cf-a093-50a79b1b5439 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:44.086356 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a43222f2-ff3f-42cf-a093-50a79b1b5439 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:44.086951 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a43222f2-ff3f-42cf-a093-50a79b1b5439 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:44.364032 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-a43222f2-ff3f-42cf-a093-50a79b1b5439 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:10:44.374711 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-a43222f2-ff3f-42cf-a093-50a79b1b5439 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1" status: 200 len: 1673 microversion: 2.1 time: 0.303778 Jun 30 10:10:44.375246 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 488/989] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:10:44 2022] GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1 => generated 1673 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:10:44.889201 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-882c8c04-cd2b-4b0e-9109-804f5d373768 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:10:44.889828 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-882c8c04-cd2b-4b0e-9109-804f5d373768 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 2283b227-4655-4c28-9ceb-e725ac71fcb9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:10:44.896437 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-882c8c04-cd2b-4b0e-9109-804f5d373768 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:44.896917 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-882c8c04-cd2b-4b0e-9109-804f5d373768 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:44.897672 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-882c8c04-cd2b-4b0e-9109-804f5d373768 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:44.898100 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-882c8c04-cd2b-4b0e-9109-804f5d373768 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:45.046627 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-882c8c04-cd2b-4b0e-9109-804f5d373768 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:10:45.055167 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-882c8c04-cd2b-4b0e-9109-804f5d373768 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/2283b227-4655-4c28-9ceb-e725ac71fcb9" status: 200 len: 1276 microversion: 2.1 time: 0.170091 Jun 30 10:10:45.055756 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 502/990] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:10:44 2022] GET /compute/v2.1/servers/2283b227-4655-4c28-9ceb-e725ac71fcb9 => generated 1276 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:10:45.395914 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-2cd3cf58-6aca-4706-821e-b73ccf0daa32 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:10:45.396627 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-2cd3cf58-6aca-4706-821e-b73ccf0daa32 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 6517c445-5926-4e1c-b6b3-981513f7cea1] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:10:45.406278 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2cd3cf58-6aca-4706-821e-b73ccf0daa32 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:45.406720 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2cd3cf58-6aca-4706-821e-b73ccf0daa32 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:45.407482 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2cd3cf58-6aca-4706-821e-b73ccf0daa32 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:45.407899 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2cd3cf58-6aca-4706-821e-b73ccf0daa32 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:45.599481 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-2cd3cf58-6aca-4706-821e-b73ccf0daa32 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:10:45.607484 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-2cd3cf58-6aca-4706-821e-b73ccf0daa32 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1" status: 200 len: 1673 microversion: 2.1 time: 0.217934 Jun 30 10:10:45.608105 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 489/991] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:10:45 2022] GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1 => generated 1673 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:10:46.078032 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-2753949d-814a-4866-9ff3-f566eb83a85d tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:10:46.078660 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-2753949d-814a-4866-9ff3-f566eb83a85d tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 2283b227-4655-4c28-9ceb-e725ac71fcb9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:10:46.085754 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2753949d-814a-4866-9ff3-f566eb83a85d tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:46.086154 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2753949d-814a-4866-9ff3-f566eb83a85d tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:46.086910 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2753949d-814a-4866-9ff3-f566eb83a85d tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:46.087547 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2753949d-814a-4866-9ff3-f566eb83a85d tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:46.413174 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-2753949d-814a-4866-9ff3-f566eb83a85d tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:10:46.421136 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-2753949d-814a-4866-9ff3-f566eb83a85d tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/2283b227-4655-4c28-9ceb-e725ac71fcb9" status: 200 len: 1264 microversion: 2.1 time: 0.347144 Jun 30 10:10:46.421713 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 503/992] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:10:46 2022] GET /compute/v2.1/servers/2283b227-4655-4c28-9ceb-e725ac71fcb9 => generated 1264 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:10:46.625819 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-00224fb4-af4a-4e20-aa96-8fab6252dc2f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:10:46.626653 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-00224fb4-af4a-4e20-aa96-8fab6252dc2f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 6517c445-5926-4e1c-b6b3-981513f7cea1] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:10:46.634634 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-00224fb4-af4a-4e20-aa96-8fab6252dc2f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:46.635073 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-00224fb4-af4a-4e20-aa96-8fab6252dc2f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:46.635835 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-00224fb4-af4a-4e20-aa96-8fab6252dc2f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:46.636291 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-00224fb4-af4a-4e20-aa96-8fab6252dc2f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:46.649978 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-a1741d19-7433-477f-8491-3491775bdbb5 req-1a4f15ac-dcbf-4e62-9461-9b443f29d061 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2283b227-4655-4c28-9ceb-e725ac71fcb9", "tag": "31d78f4e-5b71-4dd8-81c6-5f0651a00247"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:10:46.667741 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-a1741d19-7433-477f-8491-3491775bdbb5 req-1a4f15ac-dcbf-4e62-9461-9b443f29d061 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:46.668447 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-a1741d19-7433-477f-8491-3491775bdbb5 req-1a4f15ac-dcbf-4e62-9461-9b443f29d061 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:46.685712 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-a1741d19-7433-477f-8491-3491775bdbb5 req-1a4f15ac-dcbf-4e62-9461-9b443f29d061 service nova] Creating event network-changed:31d78f4e-5b71-4dd8-81c6-5f0651a00247 for instance 2283b227-4655-4c28-9ceb-e725ac71fcb9 on hv-cinder-84330 Jun 30 10:10:46.691202 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-a1741d19-7433-477f-8491-3491775bdbb5 req-1a4f15ac-dcbf-4e62-9461-9b443f29d061 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045605 Jun 30 10:10:46.691797 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 504/993] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:10:47.022495 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-00224fb4-af4a-4e20-aa96-8fab6252dc2f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:10:47.031085 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-00224fb4-af4a-4e20-aa96-8fab6252dc2f tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1" status: 200 len: 1673 microversion: 2.1 time: 0.409359 Jun 30 10:10:47.031663 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 490/994] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:10:46 2022] GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1 => generated 1673 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:10:47.440207 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-63eee18d-2762-4e5a-80be-5b5fb20f1a0b tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:10:47.440949 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-63eee18d-2762-4e5a-80be-5b5fb20f1a0b tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 2283b227-4655-4c28-9ceb-e725ac71fcb9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:10:47.447621 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-63eee18d-2762-4e5a-80be-5b5fb20f1a0b tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:47.448317 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-63eee18d-2762-4e5a-80be-5b5fb20f1a0b tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:47.449190 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-63eee18d-2762-4e5a-80be-5b5fb20f1a0b tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:47.449933 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-63eee18d-2762-4e5a-80be-5b5fb20f1a0b tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:47.586206 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-63eee18d-2762-4e5a-80be-5b5fb20f1a0b tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:10:47.593839 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-63eee18d-2762-4e5a-80be-5b5fb20f1a0b tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/2283b227-4655-4c28-9ceb-e725ac71fcb9" status: 200 len: 1264 microversion: 2.1 time: 0.158716 Jun 30 10:10:47.594401 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 505/995] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:10:47 2022] GET /compute/v2.1/servers/2283b227-4655-4c28-9ceb-e725ac71fcb9 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:10:48.048580 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-4426dcfa-736f-4ed1-b509-c6aac9c50efa tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:10:48.049718 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-4426dcfa-736f-4ed1-b509-c6aac9c50efa tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 6517c445-5926-4e1c-b6b3-981513f7cea1] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:10:48.057403 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4426dcfa-736f-4ed1-b509-c6aac9c50efa tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:48.057627 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4426dcfa-736f-4ed1-b509-c6aac9c50efa tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:48.058603 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4426dcfa-736f-4ed1-b509-c6aac9c50efa tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:48.059036 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4426dcfa-736f-4ed1-b509-c6aac9c50efa tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:48.104457 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4426dcfa-736f-4ed1-b509-c6aac9c50efa tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:48.104898 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4426dcfa-736f-4ed1-b509-c6aac9c50efa tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:48.105347 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.objects.instance [None req-4426dcfa-736f-4ed1-b509-c6aac9c50efa tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lazy-loading 'fault' on Instance uuid 6517c445-5926-4e1c-b6b3-981513f7cea1 {{(pid=117847) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:10:48.156019 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-4426dcfa-736f-4ed1-b509-c6aac9c50efa tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3593c14c5890431d8c4a986132a659b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315760a46046430780d7d4741cd8dc7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:10:48.163317 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-4426dcfa-736f-4ed1-b509-c6aac9c50efa tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1" status: 200 len: 1326 microversion: 2.1 time: 0.118645 Jun 30 10:10:48.163900 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 491/996] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:10:48 2022] GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1 => generated 1326 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:10:48.611133 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-3d35f629-4f3d-48ec-8d5c-67aeb168223a tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:10:48.611688 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-3d35f629-4f3d-48ec-8d5c-67aeb168223a tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 2283b227-4655-4c28-9ceb-e725ac71fcb9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:10:48.618518 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3d35f629-4f3d-48ec-8d5c-67aeb168223a tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:48.618957 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3d35f629-4f3d-48ec-8d5c-67aeb168223a tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:48.619705 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3d35f629-4f3d-48ec-8d5c-67aeb168223a tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:48.620169 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3d35f629-4f3d-48ec-8d5c-67aeb168223a tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:48.709964 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [req-b6ad8835-e6ed-4183-b7c4-4c3a624e56ef req-f000348d-fdff-487f-87b4-54507fefd5bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6517c445-5926-4e1c-b6b3-981513f7cea1", "name": "network-vif-deleted", "tag": "81931e61-4859-441b-a576-3e46849c8c57"}]} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:10:48.718467 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-b6ad8835-e6ed-4183-b7c4-4c3a624e56ef req-f000348d-fdff-487f-87b4-54507fefd5bf service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:48.718904 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-b6ad8835-e6ed-4183-b7c4-4c3a624e56ef req-f000348d-fdff-487f-87b4-54507fefd5bf service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:48.733206 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.compute.server_external_events [req-b6ad8835-e6ed-4183-b7c4-4c3a624e56ef req-f000348d-fdff-487f-87b4-54507fefd5bf service nova] Creating event network-vif-deleted:81931e61-4859-441b-a576-3e46849c8c57 for instance 6517c445-5926-4e1c-b6b3-981513f7cea1 on hv-cinder-84330 Jun 30 10:10:48.738364 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [req-b6ad8835-e6ed-4183-b7c4-4c3a624e56ef req-f000348d-fdff-487f-87b4-54507fefd5bf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032070 Jun 30 10:10:48.738981 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 492/997] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:10:48.762941 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-3d35f629-4f3d-48ec-8d5c-67aeb168223a tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:10:48.766640 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:48.771113 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-3d35f629-4f3d-48ec-8d5c-67aeb168223a tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/2283b227-4655-4c28-9ceb-e725ac71fcb9" status: 200 len: 1264 microversion: 2.1 time: 0.164027 Jun 30 10:10:48.771660 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 506/998] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:10:48 2022] GET /compute/v2.1/servers/2283b227-4655-4c28-9ceb-e725ac71fcb9 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:10:49.186149 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-25a63cad-78ac-4319-9563-f2d6aa40d1f8 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:10:49.186835 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-25a63cad-78ac-4319-9563-f2d6aa40d1f8 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 6517c445-5926-4e1c-b6b3-981513f7cea1] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:10:49.193893 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-25a63cad-78ac-4319-9563-f2d6aa40d1f8 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:49.194335 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-25a63cad-78ac-4319-9563-f2d6aa40d1f8 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:49.195081 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-25a63cad-78ac-4319-9563-f2d6aa40d1f8 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:49.195505 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-25a63cad-78ac-4319-9563-f2d6aa40d1f8 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:49.208762 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.wsgi [None req-25a63cad-78ac-4319-9563-f2d6aa40d1f8 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] HTTP exception thrown: Instance 6517c445-5926-4e1c-b6b3-981513f7cea1 could not be found. Jun 30 10:10:49.210405 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-25a63cad-78ac-4319-9563-f2d6aa40d1f8 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Request method failure captured: Jun 30 10:10:49.210405 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: request: GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1 HTTP/1.1 Jun 30 10:10:49.210405 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept: application/json Jun 30 10:10:49.210405 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept-Encoding: identity Jun 30 10:10:49.210405 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Connection: close Jun 30 10:10:49.210405 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Length: 0 Jun 30 10:10:49.210405 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Type: application/json Jun 30 10:10:49.210405 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Host: 10.222.0.16 Jun 30 10:10:49.210405 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Openstack-System-Scope: None Jun 30 10:10:49.210405 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: User-Agent: python-urllib3/1.26.9 Jun 30 10:10:49.210405 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Auth-Token: gAAAAABivXWxs6lbonKih3FPtqwiwqd2Ztfdo7CEZfgC9x2JfnMf-fCsmZV8SBnPPc3NnGQGJh3lkFmLjbcopW42B9ltJ9mI1cgjujPQZo_c9oF_gq-LTWybTNeSkTE48rIge9Yscr_CM33DIuqzjrVDRjgvV1wx7M8ezz5JBTdo1xTT5q2vSUo Jun 30 10:10:49.210405 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Id: None Jun 30 10:10:49.210405 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Name: None Jun 30 10:10:49.210405 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Identity-Status: Confirmed Jun 30 10:10:49.210405 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Is-Admin-Project: True Jun 30 10:10:49.210405 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Id: default Jun 30 10:10:49.210405 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Name: Default Jun 30 10:10:49.210405 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Id: 315760a46046430780d7d4741cd8dc7f Jun 30 10:10:49.210405 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Name: tempest-AttachVolumeTestJSON-1253618327 Jun 30 10:10:49.210405 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Role: reader,member Jun 30 10:10:49.210405 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Roles: reader,member Jun 30 10:10:49.212068 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/315760a46046430780d7d4741cd8dc7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/315760a46046430780d7d4741cd8dc7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/315760a46046430780d7d4741cd8dc7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_315760a46046430780d7d4741cd8dc7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:10:49.212068 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant: tempest-AttachVolumeTestJSON-1253618327 Jun 30 10:10:49.212068 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Id: 315760a46046430780d7d4741cd8dc7f Jun 30 10:10:49.212068 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1253618327 Jun 30 10:10:49.212068 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User: tempest-AttachVolumeTestJSON-1253618327-project Jun 30 10:10:49.212068 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Id: default Jun 30 10:10:49.212068 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Name: Default Jun 30 10:10:49.212068 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Id: 3593c14c5890431d8c4a986132a659b4 Jun 30 10:10:49.212068 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Name: tempest-AttachVolumeTestJSON-1253618327-project Jun 30 10:10:49.212068 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: method: > Jun 30 10:10:49.212068 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: exception: Instance 6517c445-5926-4e1c-b6b3-981513f7cea1 could not be found. Jun 30 10:10:49.212068 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: action_args: {'id': '6517c445-5926-4e1c-b6b3-981513f7cea1'} Jun 30 10:10:49.213026 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:10:49.213026 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:10:49.213026 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:10:49.213026 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:10:49.213026 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:10:49.213026 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:10:49.213026 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:10:49.213026 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:10:49.213026 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:10:49.213026 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:10:49.213026 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6517c445-5926-4e1c-b6b3-981513f7cea1 could not be found. Jun 30 10:10:49.213026 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:10:49.213026 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:10:49.213026 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:10:49.213026 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:10:49.213026 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:10:49.213026 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:10:49.213026 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:10:49.213026 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:10:49.213026 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:10:49.214373 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:10:49.214373 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:10:49.214373 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:10:49.214373 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:10:49.214373 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:10:49.214373 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:10:49.214373 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:10:49.214373 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6517c445-5926-4e1c-b6b3-981513f7cea1 could not be found. Jun 30 10:10:49.214373 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:10:49.214373 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:10:49.214373 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:10:49.214373 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:10:49.214373 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:10:49.214373 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:10:49.214373 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:10:49.214373 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:10:49.214373 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6517c445-5926-4e1c-b6b3-981513f7cea1 could not be found. Jun 30 10:10:49.214373 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:10:49.215574 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-25a63cad-78ac-4319-9563-f2d6aa40d1f8 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Returning 404 to user: Instance 6517c445-5926-4e1c-b6b3-981513f7cea1 could not be found. {{(pid=117847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:10:49.215574 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-25a63cad-78ac-4319-9563-f2d6aa40d1f8 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1" status: 404 len: 111 microversion: 2.1 time: 0.033300 Jun 30 10:10:49.215574 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 493/999] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:10:49 2022] GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:10:49.221216 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-9487c884-a389-4bd1-a254-933cee7c6781 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '.version_select at 0x7fc2203aa940>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:10:49.243263 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-9487c884-a389-4bd1-a254-933cee7c6781 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-748737555" status: 202 len: 0 microversion: 2.1 time: 0.025946 Jun 30 10:10:49.243814 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 507/1000] 10.222.0.16 () {58 vars in 1217 bytes} [Thu Jun 30 10:10:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-748737555 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:10:49.787197 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-2265d9ec-0f3c-43e7-8dec-2b39c065b921 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:10:49.787979 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-2265d9ec-0f3c-43e7-8dec-2b39c065b921 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 2283b227-4655-4c28-9ceb-e725ac71fcb9] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:10:49.794827 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2265d9ec-0f3c-43e7-8dec-2b39c065b921 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:49.795288 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2265d9ec-0f3c-43e7-8dec-2b39c065b921 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:49.796125 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2265d9ec-0f3c-43e7-8dec-2b39c065b921 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:49.796560 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2265d9ec-0f3c-43e7-8dec-2b39c065b921 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:49.936833 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-2265d9ec-0f3c-43e7-8dec-2b39c065b921 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:10:49.945165 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-2265d9ec-0f3c-43e7-8dec-2b39c065b921 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/2283b227-4655-4c28-9ceb-e725ac71fcb9" status: 200 len: 1264 microversion: 2.1 time: 0.161959 Jun 30 10:10:49.945724 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 494/1001] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:10:49 2022] GET /compute/v2.1/servers/2283b227-4655-4c28-9ceb-e725ac71fcb9 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:10:51.021816 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-87cee298-f0a2-4178-9a4e-9f99aea8f6c6 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:10:51.022477 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-87cee298-f0a2-4178-9a4e-9f99aea8f6c6 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 2283b227-4655-4c28-9ceb-e725ac71fcb9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:10:51.028821 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-87cee298-f0a2-4178-9a4e-9f99aea8f6c6 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:51.029278 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-87cee298-f0a2-4178-9a4e-9f99aea8f6c6 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:51.030079 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-87cee298-f0a2-4178-9a4e-9f99aea8f6c6 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:51.030482 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-87cee298-f0a2-4178-9a4e-9f99aea8f6c6 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:51.167032 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-87cee298-f0a2-4178-9a4e-9f99aea8f6c6 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:10:51.175125 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-87cee298-f0a2-4178-9a4e-9f99aea8f6c6 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/2283b227-4655-4c28-9ceb-e725ac71fcb9" status: 200 len: 1264 microversion: 2.1 time: 0.217035 Jun 30 10:10:51.175683 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 508/1002] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:10:50 2022] GET /compute/v2.1/servers/2283b227-4655-4c28-9ceb-e725ac71fcb9 => generated 1264 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:10:52.181926 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-9acf3c48-c4a9-461d-bc8a-2bc7de79d087 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:10:52.182524 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-9acf3c48-c4a9-461d-bc8a-2bc7de79d087 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 6517c445-5926-4e1c-b6b3-981513f7cea1] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:10:52.190273 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9acf3c48-c4a9-461d-bc8a-2bc7de79d087 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:52.190866 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9acf3c48-c4a9-461d-bc8a-2bc7de79d087 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:52.191551 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9acf3c48-c4a9-461d-bc8a-2bc7de79d087 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:52.192043 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9acf3c48-c4a9-461d-bc8a-2bc7de79d087 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:52.193314 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-7138ae0a-6a98-45ac-8962-81c5fba04319 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:10:52.193923 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-7138ae0a-6a98-45ac-8962-81c5fba04319 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 2283b227-4655-4c28-9ceb-e725ac71fcb9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:10:52.200096 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7138ae0a-6a98-45ac-8962-81c5fba04319 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:52.200546 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7138ae0a-6a98-45ac-8962-81c5fba04319 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:52.201307 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7138ae0a-6a98-45ac-8962-81c5fba04319 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:52.201733 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7138ae0a-6a98-45ac-8962-81c5fba04319 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:52.205938 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.wsgi [None req-9acf3c48-c4a9-461d-bc8a-2bc7de79d087 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] HTTP exception thrown: Instance 6517c445-5926-4e1c-b6b3-981513f7cea1 could not be found. Jun 30 10:10:52.207511 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-9acf3c48-c4a9-461d-bc8a-2bc7de79d087 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Request method failure captured: Jun 30 10:10:52.207511 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: request: DELETE /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1 HTTP/1.1 Jun 30 10:10:52.207511 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept: application/json Jun 30 10:10:52.207511 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept-Encoding: identity Jun 30 10:10:52.207511 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Connection: close Jun 30 10:10:52.207511 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Length: 0 Jun 30 10:10:52.207511 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Type: application/json Jun 30 10:10:52.207511 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Host: 10.222.0.16 Jun 30 10:10:52.207511 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Openstack-System-Scope: None Jun 30 10:10:52.207511 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: User-Agent: python-urllib3/1.26.9 Jun 30 10:10:52.207511 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Auth-Token: gAAAAABivXWxs6lbonKih3FPtqwiwqd2Ztfdo7CEZfgC9x2JfnMf-fCsmZV8SBnPPc3NnGQGJh3lkFmLjbcopW42B9ltJ9mI1cgjujPQZo_c9oF_gq-LTWybTNeSkTE48rIge9Yscr_CM33DIuqzjrVDRjgvV1wx7M8ezz5JBTdo1xTT5q2vSUo Jun 30 10:10:52.207511 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Id: None Jun 30 10:10:52.207511 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Name: None Jun 30 10:10:52.207511 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Identity-Status: Confirmed Jun 30 10:10:52.207511 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Is-Admin-Project: True Jun 30 10:10:52.207511 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Id: default Jun 30 10:10:52.207511 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Name: Default Jun 30 10:10:52.207511 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Id: 315760a46046430780d7d4741cd8dc7f Jun 30 10:10:52.207511 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Name: tempest-AttachVolumeTestJSON-1253618327 Jun 30 10:10:52.207511 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Role: reader,member Jun 30 10:10:52.207511 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Roles: reader,member Jun 30 10:10:52.209105 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/315760a46046430780d7d4741cd8dc7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/315760a46046430780d7d4741cd8dc7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/315760a46046430780d7d4741cd8dc7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_315760a46046430780d7d4741cd8dc7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:10:52.209105 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant: tempest-AttachVolumeTestJSON-1253618327 Jun 30 10:10:52.209105 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Id: 315760a46046430780d7d4741cd8dc7f Jun 30 10:10:52.209105 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1253618327 Jun 30 10:10:52.209105 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User: tempest-AttachVolumeTestJSON-1253618327-project Jun 30 10:10:52.209105 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Id: default Jun 30 10:10:52.209105 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Name: Default Jun 30 10:10:52.209105 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Id: 3593c14c5890431d8c4a986132a659b4 Jun 30 10:10:52.209105 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Name: tempest-AttachVolumeTestJSON-1253618327-project Jun 30 10:10:52.209105 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: method: > Jun 30 10:10:52.209105 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: exception: Instance 6517c445-5926-4e1c-b6b3-981513f7cea1 could not be found. Jun 30 10:10:52.209105 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: action_args: {'id': '6517c445-5926-4e1c-b6b3-981513f7cea1'} Jun 30 10:10:52.212682 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:10:52.212682 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:10:52.212682 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:10:52.212682 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:10:52.212682 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:10:52.212682 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:10:52.212682 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:10:52.212682 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:10:52.212682 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:10:52.212682 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:10:52.212682 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6517c445-5926-4e1c-b6b3-981513f7cea1 could not be found. Jun 30 10:10:52.212682 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:10:52.212682 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:10:52.212682 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:10:52.212682 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:10:52.212682 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:10:52.212682 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:10:52.212682 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:10:52.212682 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:10:52.212682 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:10:52.214163 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:10:52.214163 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 10:10:52.214163 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 10:10:52.214163 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 10:10:52.214163 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 10:10:52.214163 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:10:52.214163 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:10:52.214163 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:10:52.214163 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:10:52.214163 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6517c445-5926-4e1c-b6b3-981513f7cea1 could not be found. Jun 30 10:10:52.214163 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:10:52.214163 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:10:52.214163 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:10:52.214163 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:10:52.214163 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:10:52.214163 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:10:52.214163 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:10:52.214163 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:10:52.214163 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6517c445-5926-4e1c-b6b3-981513f7cea1 could not be found. Jun 30 10:10:52.214163 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:10:52.215699 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-9acf3c48-c4a9-461d-bc8a-2bc7de79d087 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Returning 404 to user: Instance 6517c445-5926-4e1c-b6b3-981513f7cea1 could not be found. {{(pid=117847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:10:52.215699 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-9acf3c48-c4a9-461d-bc8a-2bc7de79d087 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1" status: 404 len: 111 microversion: 2.1 time: 0.031933 Jun 30 10:10:52.215699 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 495/1003] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 10:10:52 2022] DELETE /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:10:52.220808 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-a3ebd90d-6092-42f9-88c5-96fd38788ed3 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:10:52.221439 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-a3ebd90d-6092-42f9-88c5-96fd38788ed3 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 6517c445-5926-4e1c-b6b3-981513f7cea1] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:10:52.227476 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a3ebd90d-6092-42f9-88c5-96fd38788ed3 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:52.227925 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a3ebd90d-6092-42f9-88c5-96fd38788ed3 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:52.228694 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a3ebd90d-6092-42f9-88c5-96fd38788ed3 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:52.229124 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a3ebd90d-6092-42f9-88c5-96fd38788ed3 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:52.243083 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.wsgi [None req-a3ebd90d-6092-42f9-88c5-96fd38788ed3 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] HTTP exception thrown: Instance 6517c445-5926-4e1c-b6b3-981513f7cea1 could not be found. Jun 30 10:10:52.244685 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-a3ebd90d-6092-42f9-88c5-96fd38788ed3 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Request method failure captured: Jun 30 10:10:52.244685 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: request: GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1 HTTP/1.1 Jun 30 10:10:52.244685 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept: application/json Jun 30 10:10:52.244685 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept-Encoding: identity Jun 30 10:10:52.244685 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Connection: close Jun 30 10:10:52.244685 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Length: 0 Jun 30 10:10:52.244685 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Type: application/json Jun 30 10:10:52.244685 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Host: 10.222.0.16 Jun 30 10:10:52.244685 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Openstack-System-Scope: None Jun 30 10:10:52.244685 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: User-Agent: python-urllib3/1.26.9 Jun 30 10:10:52.244685 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Auth-Token: gAAAAABivXWxs6lbonKih3FPtqwiwqd2Ztfdo7CEZfgC9x2JfnMf-fCsmZV8SBnPPc3NnGQGJh3lkFmLjbcopW42B9ltJ9mI1cgjujPQZo_c9oF_gq-LTWybTNeSkTE48rIge9Yscr_CM33DIuqzjrVDRjgvV1wx7M8ezz5JBTdo1xTT5q2vSUo Jun 30 10:10:52.244685 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Id: None Jun 30 10:10:52.244685 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Name: None Jun 30 10:10:52.244685 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Identity-Status: Confirmed Jun 30 10:10:52.244685 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Is-Admin-Project: True Jun 30 10:10:52.244685 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Id: default Jun 30 10:10:52.244685 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Name: Default Jun 30 10:10:52.244685 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Id: 315760a46046430780d7d4741cd8dc7f Jun 30 10:10:52.244685 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Name: tempest-AttachVolumeTestJSON-1253618327 Jun 30 10:10:52.244685 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Role: reader,member Jun 30 10:10:52.244685 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Roles: reader,member Jun 30 10:10:52.246290 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/315760a46046430780d7d4741cd8dc7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/315760a46046430780d7d4741cd8dc7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/315760a46046430780d7d4741cd8dc7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_315760a46046430780d7d4741cd8dc7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:10:52.246290 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant: tempest-AttachVolumeTestJSON-1253618327 Jun 30 10:10:52.246290 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Id: 315760a46046430780d7d4741cd8dc7f Jun 30 10:10:52.246290 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1253618327 Jun 30 10:10:52.246290 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User: tempest-AttachVolumeTestJSON-1253618327-project Jun 30 10:10:52.246290 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Id: default Jun 30 10:10:52.246290 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Name: Default Jun 30 10:10:52.246290 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Id: 3593c14c5890431d8c4a986132a659b4 Jun 30 10:10:52.246290 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Name: tempest-AttachVolumeTestJSON-1253618327-project Jun 30 10:10:52.246290 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: method: > Jun 30 10:10:52.246290 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: exception: Instance 6517c445-5926-4e1c-b6b3-981513f7cea1 could not be found. Jun 30 10:10:52.246290 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: action_args: {'id': '6517c445-5926-4e1c-b6b3-981513f7cea1'} Jun 30 10:10:52.247943 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:10:52.247943 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:10:52.247943 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:10:52.247943 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:10:52.247943 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:10:52.247943 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:10:52.247943 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:10:52.247943 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:10:52.247943 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:10:52.247943 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:10:52.247943 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6517c445-5926-4e1c-b6b3-981513f7cea1 could not be found. Jun 30 10:10:52.247943 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:10:52.247943 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:10:52.247943 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:10:52.247943 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:10:52.247943 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:10:52.247943 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:10:52.247943 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:10:52.247943 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:10:52.247943 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:10:52.249464 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:10:52.249464 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:10:52.249464 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:10:52.249464 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:10:52.249464 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:10:52.249464 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:10:52.249464 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:10:52.249464 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6517c445-5926-4e1c-b6b3-981513f7cea1 could not be found. Jun 30 10:10:52.249464 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:10:52.249464 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:10:52.249464 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:10:52.249464 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:10:52.249464 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:10:52.249464 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:10:52.249464 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:10:52.249464 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:10:52.249464 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6517c445-5926-4e1c-b6b3-981513f7cea1 could not be found. Jun 30 10:10:52.249464 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:10:52.250884 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-a3ebd90d-6092-42f9-88c5-96fd38788ed3 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Returning 404 to user: Instance 6517c445-5926-4e1c-b6b3-981513f7cea1 could not be found. {{(pid=117847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:10:52.250884 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-a3ebd90d-6092-42f9-88c5-96fd38788ed3 tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1" status: 404 len: 111 microversion: 2.1 time: 0.028922 Jun 30 10:10:52.250884 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 496/1004] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:10:52 2022] GET /compute/v2.1/servers/6517c445-5926-4e1c-b6b3-981513f7cea1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:10:52.344912 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7138ae0a-6a98-45ac-8962-81c5fba04319 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:10:52.364199 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-7138ae0a-6a98-45ac-8962-81c5fba04319 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/2283b227-4655-4c28-9ceb-e725ac71fcb9" status: 200 len: 1264 microversion: 2.1 time: 0.175322 Jun 30 10:10:52.364781 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 509/1005] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:10:52 2022] GET /compute/v2.1/servers/2283b227-4655-4c28-9ceb-e725ac71fcb9 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:10:53.381691 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-f3744eab-36be-4753-a031-fc9042491e33 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:10:53.382375 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-f3744eab-36be-4753-a031-fc9042491e33 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 2283b227-4655-4c28-9ceb-e725ac71fcb9] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:10:53.384360 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell0:SELECT=2 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:53.384986 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell0:SELECT=6 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:53.386269 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:53.392632 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-2384c012-da6c-4f49-826d-4b9ea2bd182d tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:10:53.393123 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-2384c012-da6c-4f49-826d-4b9ea2bd182d tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:10:53.393237 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-f3744eab-36be-4753-a031-fc9042491e33 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:53.393676 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-f3744eab-36be-4753-a031-fc9042491e33 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:53.394441 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-f3744eab-36be-4753-a031-fc9042491e33 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:53.394876 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-f3744eab-36be-4753-a031-fc9042491e33 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:53.394983 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=2 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:53.400049 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:53.400735 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2384c012-da6c-4f49-826d-4b9ea2bd182d tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:53.401181 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2384c012-da6c-4f49-826d-4b9ea2bd182d tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:53.401935 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2384c012-da6c-4f49-826d-4b9ea2bd182d tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:53.402361 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2384c012-da6c-4f49-826d-4b9ea2bd182d tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:53.416617 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-2384c012-da6c-4f49-826d-4b9ea2bd182d tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] HTTP exception thrown: Instance 27789fd0-038a-4d0d-b26f-4b5f5c0d8685 could not be found. Jun 30 10:10:53.418349 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-2384c012-da6c-4f49-826d-4b9ea2bd182d tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Request method failure captured: Jun 30 10:10:53.418349 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: request: DELETE /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 HTTP/1.1 Jun 30 10:10:53.418349 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept: application/json Jun 30 10:10:53.418349 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jun 30 10:10:53.418349 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Connection: close Jun 30 10:10:53.418349 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jun 30 10:10:53.418349 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jun 30 10:10:53.418349 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Host: 10.222.0.16 Jun 30 10:10:53.418349 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jun 30 10:10:53.418349 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jun 30 10:10:53.418349 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABivXWxs6lbonKih3FPtqwiwqd2Ztfdo7CEZfgC9x2JfnMf-fCsmZV8SBnPPc3NnGQGJh3lkFmLjbcopW42B9ltJ9mI1cgjujPQZo_c9oF_gq-LTWybTNeSkTE48rIge9Yscr_CM33DIuqzjrVDRjgvV1wx7M8ezz5JBTdo1xTT5q2vSUo Jun 30 10:10:53.418349 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jun 30 10:10:53.418349 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jun 30 10:10:53.418349 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jun 30 10:10:53.418349 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jun 30 10:10:53.418349 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jun 30 10:10:53.418349 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jun 30 10:10:53.418349 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Id: 315760a46046430780d7d4741cd8dc7f Jun 30 10:10:53.418349 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-AttachVolumeTestJSON-1253618327 Jun 30 10:10:53.418349 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Role: reader,member Jun 30 10:10:53.418349 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Roles: reader,member Jun 30 10:10:53.420202 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/315760a46046430780d7d4741cd8dc7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/315760a46046430780d7d4741cd8dc7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/315760a46046430780d7d4741cd8dc7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_315760a46046430780d7d4741cd8dc7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:10:53.420202 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-AttachVolumeTestJSON-1253618327 Jun 30 10:10:53.420202 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 315760a46046430780d7d4741cd8dc7f Jun 30 10:10:53.420202 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1253618327 Jun 30 10:10:53.420202 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User: tempest-AttachVolumeTestJSON-1253618327-project Jun 30 10:10:53.420202 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jun 30 10:10:53.420202 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jun 30 10:10:53.420202 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Id: 3593c14c5890431d8c4a986132a659b4 Jun 30 10:10:53.420202 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-AttachVolumeTestJSON-1253618327-project Jun 30 10:10:53.420202 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: method: > Jun 30 10:10:53.420202 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: exception: Instance 27789fd0-038a-4d0d-b26f-4b5f5c0d8685 could not be found. Jun 30 10:10:53.420202 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: action_args: {'id': '27789fd0-038a-4d0d-b26f-4b5f5c0d8685'} Jun 30 10:10:53.421026 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:10:53.421026 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:10:53.421026 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:10:53.421026 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:10:53.421026 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:10:53.421026 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:10:53.421026 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:10:53.421026 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:10:53.421026 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:10:53.421026 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:10:53.421026 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27789fd0-038a-4d0d-b26f-4b5f5c0d8685 could not be found. Jun 30 10:10:53.421026 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:10:53.421026 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:10:53.421026 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:10:53.421026 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:10:53.421026 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:10:53.421026 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:10:53.421026 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:10:53.421026 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:10:53.421026 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:10:53.422260 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:10:53.422260 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 10:10:53.422260 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 10:10:53.422260 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 10:10:53.422260 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 10:10:53.422260 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:10:53.422260 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:10:53.422260 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:10:53.422260 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:10:53.422260 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27789fd0-038a-4d0d-b26f-4b5f5c0d8685 could not be found. Jun 30 10:10:53.422260 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:10:53.422260 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:10:53.422260 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:10:53.422260 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:10:53.422260 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:10:53.422260 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:10:53.422260 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:10:53.422260 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:10:53.422260 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27789fd0-038a-4d0d-b26f-4b5f5c0d8685 could not be found. Jun 30 10:10:53.422260 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:10:53.423527 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-2384c012-da6c-4f49-826d-4b9ea2bd182d tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Returning 404 to user: Instance 27789fd0-038a-4d0d-b26f-4b5f5c0d8685 could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:10:53.423527 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-2384c012-da6c-4f49-826d-4b9ea2bd182d tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "DELETE /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 404 len: 111 microversion: 2.1 time: 0.031027 Jun 30 10:10:53.423527 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 510/1006] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 10:10:53 2022] DELETE /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:10:53.428339 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-aabdd8c5-e002-47f9-b5b3-b59b2d53058a tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:10:53.428940 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-aabdd8c5-e002-47f9-b5b3-b59b2d53058a tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] [instance: 27789fd0-038a-4d0d-b26f-4b5f5c0d8685] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:10:53.437170 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-aabdd8c5-e002-47f9-b5b3-b59b2d53058a tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:53.437544 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-aabdd8c5-e002-47f9-b5b3-b59b2d53058a tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:53.438299 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-aabdd8c5-e002-47f9-b5b3-b59b2d53058a tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:53.438752 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-aabdd8c5-e002-47f9-b5b3-b59b2d53058a tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:53.452767 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-aabdd8c5-e002-47f9-b5b3-b59b2d53058a tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] HTTP exception thrown: Instance 27789fd0-038a-4d0d-b26f-4b5f5c0d8685 could not be found. Jun 30 10:10:53.454448 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-aabdd8c5-e002-47f9-b5b3-b59b2d53058a tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Request method failure captured: Jun 30 10:10:53.454448 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: request: GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 HTTP/1.1 Jun 30 10:10:53.454448 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept: application/json Jun 30 10:10:53.454448 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jun 30 10:10:53.454448 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Connection: close Jun 30 10:10:53.454448 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jun 30 10:10:53.454448 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jun 30 10:10:53.454448 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Host: 10.222.0.16 Jun 30 10:10:53.454448 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jun 30 10:10:53.454448 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jun 30 10:10:53.454448 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABivXWxs6lbonKih3FPtqwiwqd2Ztfdo7CEZfgC9x2JfnMf-fCsmZV8SBnPPc3NnGQGJh3lkFmLjbcopW42B9ltJ9mI1cgjujPQZo_c9oF_gq-LTWybTNeSkTE48rIge9Yscr_CM33DIuqzjrVDRjgvV1wx7M8ezz5JBTdo1xTT5q2vSUo Jun 30 10:10:53.454448 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jun 30 10:10:53.454448 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jun 30 10:10:53.454448 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jun 30 10:10:53.454448 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jun 30 10:10:53.454448 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jun 30 10:10:53.454448 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jun 30 10:10:53.454448 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Id: 315760a46046430780d7d4741cd8dc7f Jun 30 10:10:53.454448 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-AttachVolumeTestJSON-1253618327 Jun 30 10:10:53.454448 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Role: reader,member Jun 30 10:10:53.454448 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Roles: reader,member Jun 30 10:10:53.455957 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/315760a46046430780d7d4741cd8dc7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/315760a46046430780d7d4741cd8dc7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/315760a46046430780d7d4741cd8dc7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_315760a46046430780d7d4741cd8dc7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:10:53.455957 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-AttachVolumeTestJSON-1253618327 Jun 30 10:10:53.455957 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 315760a46046430780d7d4741cd8dc7f Jun 30 10:10:53.455957 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1253618327 Jun 30 10:10:53.455957 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User: tempest-AttachVolumeTestJSON-1253618327-project Jun 30 10:10:53.455957 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jun 30 10:10:53.455957 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jun 30 10:10:53.455957 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Id: 3593c14c5890431d8c4a986132a659b4 Jun 30 10:10:53.455957 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-AttachVolumeTestJSON-1253618327-project Jun 30 10:10:53.455957 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: method: > Jun 30 10:10:53.455957 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: exception: Instance 27789fd0-038a-4d0d-b26f-4b5f5c0d8685 could not be found. Jun 30 10:10:53.455957 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: action_args: {'id': '27789fd0-038a-4d0d-b26f-4b5f5c0d8685'} Jun 30 10:10:53.456793 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:10:53.456793 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:10:53.456793 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:10:53.456793 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:10:53.456793 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:10:53.456793 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:10:53.456793 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:10:53.456793 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:10:53.456793 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:10:53.456793 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:10:53.456793 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27789fd0-038a-4d0d-b26f-4b5f5c0d8685 could not be found. Jun 30 10:10:53.456793 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:10:53.456793 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:10:53.456793 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:10:53.456793 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:10:53.456793 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:10:53.456793 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:10:53.456793 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:10:53.456793 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:10:53.456793 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:10:53.458097 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:10:53.458097 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:10:53.458097 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:10:53.458097 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:10:53.458097 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:10:53.458097 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:10:53.458097 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:10:53.458097 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27789fd0-038a-4d0d-b26f-4b5f5c0d8685 could not be found. Jun 30 10:10:53.458097 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:10:53.458097 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:10:53.458097 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:10:53.458097 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:10:53.458097 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:10:53.458097 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:10:53.458097 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:10:53.458097 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:10:53.458097 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27789fd0-038a-4d0d-b26f-4b5f5c0d8685 could not be found. Jun 30 10:10:53.458097 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:10:53.459548 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-aabdd8c5-e002-47f9-b5b3-b59b2d53058a tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] Returning 404 to user: Instance 27789fd0-038a-4d0d-b26f-4b5f5c0d8685 could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:10:53.459548 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-aabdd8c5-e002-47f9-b5b3-b59b2d53058a tempest-AttachVolumeTestJSON-1253618327 tempest-AttachVolumeTestJSON-1253618327-project] 10.222.0.16 "GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685" status: 404 len: 111 microversion: 2.1 time: 0.031108 Jun 30 10:10:53.459548 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 511/1007] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:10:53 2022] GET /compute/v2.1/servers/27789fd0-038a-4d0d-b26f-4b5f5c0d8685 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:10:53.537314 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-f3744eab-36be-4753-a031-fc9042491e33 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:10:53.545161 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-f3744eab-36be-4753-a031-fc9042491e33 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/2283b227-4655-4c28-9ceb-e725ac71fcb9" status: 200 len: 1264 microversion: 2.1 time: 0.167288 Jun 30 10:10:53.545737 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 497/1008] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:10:53 2022] GET /compute/v2.1/servers/2283b227-4655-4c28-9ceb-e725ac71fcb9 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:10:54.562655 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-1b315e03-90ae-4d84-86c5-b8b4fe0ba64f tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:10:54.563254 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-1b315e03-90ae-4d84-86c5-b8b4fe0ba64f tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 2283b227-4655-4c28-9ceb-e725ac71fcb9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:10:54.565718 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:54.571158 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1b315e03-90ae-4d84-86c5-b8b4fe0ba64f tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:54.571603 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1b315e03-90ae-4d84-86c5-b8b4fe0ba64f tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:54.572998 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1b315e03-90ae-4d84-86c5-b8b4fe0ba64f tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:54.573431 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1b315e03-90ae-4d84-86c5-b8b4fe0ba64f tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:54.715371 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-1b315e03-90ae-4d84-86c5-b8b4fe0ba64f tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:10:54.723566 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-1b315e03-90ae-4d84-86c5-b8b4fe0ba64f tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/2283b227-4655-4c28-9ceb-e725ac71fcb9" status: 200 len: 1264 microversion: 2.1 time: 0.164922 Jun 30 10:10:54.724422 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 512/1009] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:10:54 2022] GET /compute/v2.1/servers/2283b227-4655-4c28-9ceb-e725ac71fcb9 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:10:55.740877 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-9d91c849-7a52-4476-b857-160f1b152f7c tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:10:55.741562 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-9d91c849-7a52-4476-b857-160f1b152f7c tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 2283b227-4655-4c28-9ceb-e725ac71fcb9] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:10:55.748728 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9d91c849-7a52-4476-b857-160f1b152f7c tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:55.749154 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9d91c849-7a52-4476-b857-160f1b152f7c tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:55.750072 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9d91c849-7a52-4476-b857-160f1b152f7c tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:55.750446 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9d91c849-7a52-4476-b857-160f1b152f7c tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:56.160156 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-9d91c849-7a52-4476-b857-160f1b152f7c tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:10:56.168514 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-9d91c849-7a52-4476-b857-160f1b152f7c tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/2283b227-4655-4c28-9ceb-e725ac71fcb9" status: 200 len: 1264 microversion: 2.1 time: 0.431475 Jun 30 10:10:56.169175 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 498/1010] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:10:55 2022] GET /compute/v2.1/servers/2283b227-4655-4c28-9ceb-e725ac71fcb9 => generated 1264 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:10:56.440051 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-07d0cf45-8e04-455b-a4ce-9ec403cdd74e req-3a498367-805e-4a7d-8a06-4543022184b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2283b227-4655-4c28-9ceb-e725ac71fcb9", "name": "network-vif-plugged", "status": "completed", "tag": "31d78f4e-5b71-4dd8-81c6-5f0651a00247"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:10:56.450337 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-07d0cf45-8e04-455b-a4ce-9ec403cdd74e req-3a498367-805e-4a7d-8a06-4543022184b5 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:56.450769 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-07d0cf45-8e04-455b-a4ce-9ec403cdd74e req-3a498367-805e-4a7d-8a06-4543022184b5 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:56.465662 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-07d0cf45-8e04-455b-a4ce-9ec403cdd74e req-3a498367-805e-4a7d-8a06-4543022184b5 service nova] Creating event network-vif-plugged:31d78f4e-5b71-4dd8-81c6-5f0651a00247 for instance 2283b227-4655-4c28-9ceb-e725ac71fcb9 on hv-cinder-84330 Jun 30 10:10:56.471974 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-07d0cf45-8e04-455b-a4ce-9ec403cdd74e req-3a498367-805e-4a7d-8a06-4543022184b5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043428 Jun 30 10:10:56.472885 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 513/1011] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:10:57.186643 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-118045ae-c21b-403e-8bee-41eb9d36900d tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:10:57.187640 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-118045ae-c21b-403e-8bee-41eb9d36900d tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 2283b227-4655-4c28-9ceb-e725ac71fcb9] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:10:57.194958 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-118045ae-c21b-403e-8bee-41eb9d36900d tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:57.195631 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-118045ae-c21b-403e-8bee-41eb9d36900d tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:57.196431 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-118045ae-c21b-403e-8bee-41eb9d36900d tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:57.196866 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-118045ae-c21b-403e-8bee-41eb9d36900d tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:57.357798 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-118045ae-c21b-403e-8bee-41eb9d36900d tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:10:57.365478 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-118045ae-c21b-403e-8bee-41eb9d36900d tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/2283b227-4655-4c28-9ceb-e725ac71fcb9" status: 200 len: 1264 microversion: 2.1 time: 0.183395 Jun 30 10:10:57.366302 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 499/1012] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:10:57 2022] GET /compute/v2.1/servers/2283b227-4655-4c28-9ceb-e725ac71fcb9 => generated 1264 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:10:57.932877 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ee1d9ced-8438-4319-9d3e-93284b3fb31a tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] Action: 'create', calling method: .version_select at 0x7fc2204fe040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-57346833"}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:10:58.250953 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ee1d9ced-8438-4319-9d3e-93284b3fb31a tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 0.434940 Jun 30 10:10:58.251584 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 514/1013] 10.222.0.16 () {60 vars in 1154 bytes} [Thu Jun 30 10:10:57 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 436 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 30 10:10:58.262457 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-ec4721dd-98a8-4dbf-b03b-e6092d877300 tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] Calling method '.version_select at 0x7fc224c1f820>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:10:58.315219 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-ec4721dd-98a8-4dbf-b03b-e6092d877300 tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/ce24d9c8-9587-495e-add0-919573ff686f" status: 200 len: 343 microversion: 2.1 time: 0.056561 Jun 30 10:10:58.315836 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 500/1014] 10.222.0.16 () {58 vars in 1244 bytes} [Thu Jun 30 10:10:58 2022] GET /compute/v2.1/os-volumes/ce24d9c8-9587-495e-add0-919573ff686f => generated 343 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:10:58.382131 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-5383e25d-771c-4410-ba70-1e7f1a348985 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:10:58.382843 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-5383e25d-771c-4410-ba70-1e7f1a348985 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 2283b227-4655-4c28-9ceb-e725ac71fcb9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:10:58.392174 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5383e25d-771c-4410-ba70-1e7f1a348985 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:58.392705 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5383e25d-771c-4410-ba70-1e7f1a348985 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:58.393482 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5383e25d-771c-4410-ba70-1e7f1a348985 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:58.393919 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5383e25d-771c-4410-ba70-1e7f1a348985 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:58.541835 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-5383e25d-771c-4410-ba70-1e7f1a348985 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:10:58.549782 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-5383e25d-771c-4410-ba70-1e7f1a348985 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/2283b227-4655-4c28-9ceb-e725ac71fcb9" status: 200 len: 1451 microversion: 2.1 time: 0.171641 Jun 30 10:10:58.550308 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 515/1015] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:10:58 2022] GET /compute/v2.1/servers/2283b227-4655-4c28-9ceb-e725ac71fcb9 => generated 1451 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:10:58.570217 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-880fea3e-046d-40a4-be55-bcfc3fee2f7d tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:10:58.571278 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-880fea3e-046d-40a4-be55-bcfc3fee2f7d tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 2283b227-4655-4c28-9ceb-e725ac71fcb9] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:10:58.581162 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-880fea3e-046d-40a4-be55-bcfc3fee2f7d tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:58.581873 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-880fea3e-046d-40a4-be55-bcfc3fee2f7d tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:58.583171 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-880fea3e-046d-40a4-be55-bcfc3fee2f7d tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:10:58.583612 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-880fea3e-046d-40a4-be55-bcfc3fee2f7d tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:10:58.731600 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-880fea3e-046d-40a4-be55-bcfc3fee2f7d tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:10:58.742120 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-880fea3e-046d-40a4-be55-bcfc3fee2f7d tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/2283b227-4655-4c28-9ceb-e725ac71fcb9" status: 200 len: 1451 microversion: 2.1 time: 0.178388 Jun 30 10:10:58.742880 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 501/1016] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:10:58 2022] GET /compute/v2.1/servers/2283b227-4655-4c28-9ceb-e725ac71fcb9 => generated 1451 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:10:59.328337 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-897af38b-266a-4764-8de4-b58b69041c0a tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] Calling method '.version_select at 0x7fc220757790>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:10:59.378417 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-897af38b-266a-4764-8de4-b58b69041c0a tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/ce24d9c8-9587-495e-add0-919573ff686f" status: 200 len: 344 microversion: 2.1 time: 0.054051 Jun 30 10:10:59.378990 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 516/1017] 10.222.0.16 () {58 vars in 1244 bytes} [Thu Jun 30 10:10:59 2022] GET /compute/v2.1/os-volumes/ce24d9c8-9587-495e-add0-919573ff686f => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:10:59.390586 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-7cf93246-debc-4240-9991-102d17093121 tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] Action: 'create', calling method: .version_select at 0x7fc224ba33a0>, body: {"snapshot": {"volume_id": "ce24d9c8-9587-495e-add0-919573ff686f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1678310229"}} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:10:59.552727 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-7cf93246-debc-4240-9991-102d17093121 tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.166172 Jun 30 10:10:59.553453 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 502/1018] 10.222.0.16 () {60 vars in 1161 bytes} [Thu Jun 30 10:10:59 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:10:59.567424 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-bea6a3a7-0ada-46cb-9db0-73613c40d70e tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] Calling method '.version_select at 0x7fc220273820>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:10:59.599486 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-bea6a3a7-0ada-46cb-9db0-73613c40d70e tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/304567b5-a9a8-4531-a2f0-13d6e9fb28cb" status: 200 len: 287 microversion: 2.1 time: 0.039333 Jun 30 10:10:59.600216 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 517/1019] 10.222.0.16 () {58 vars in 1250 bytes} [Thu Jun 30 10:10:59 2022] GET /compute/v2.1/os-snapshots/304567b5-a9a8-4531-a2f0-13d6e9fb28cb => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:10:59.610752 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-bf719790-9fa0-4314-a8a8-3728dc3e4eef tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] Calling method '.version_select at 0x7fc224b7aee0>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:10:59.639830 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-bf719790-9fa0-4314-a8a8-3728dc3e4eef tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.033480 Jun 30 10:10:59.640600 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 503/1020] 10.222.0.16 () {58 vars in 1139 bytes} [Thu Jun 30 10:10:59 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:10:59.650482 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-fce6dea4-165d-49e9-bc32-9c7579e299bd tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] Calling method '.version_select at 0x7fc2201fa5e0>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:10:59.682620 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-fce6dea4-165d-49e9-bc32-9c7579e299bd tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/304567b5-a9a8-4531-a2f0-13d6e9fb28cb" status: 200 len: 287 microversion: 2.1 time: 0.035925 Jun 30 10:10:59.683298 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 518/1021] 10.222.0.16 () {58 vars in 1250 bytes} [Thu Jun 30 10:10:59 2022] GET /compute/v2.1/os-snapshots/304567b5-a9a8-4531-a2f0-13d6e9fb28cb => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:11:00.479321 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [req-7c1bd6e1-4a5f-4a63-b644-30e9a6d1fd0b req-6da93e35-0c5a-4f53-a2dc-abfa9f00749a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2283b227-4655-4c28-9ceb-e725ac71fcb9", "tag": "31d78f4e-5b71-4dd8-81c6-5f0651a00247"}]} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:11:00.489036 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-7c1bd6e1-4a5f-4a63-b644-30e9a6d1fd0b req-6da93e35-0c5a-4f53-a2dc-abfa9f00749a service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:00.489547 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-7c1bd6e1-4a5f-4a63-b644-30e9a6d1fd0b req-6da93e35-0c5a-4f53-a2dc-abfa9f00749a service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:00.500214 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.compute.server_external_events [req-7c1bd6e1-4a5f-4a63-b644-30e9a6d1fd0b req-6da93e35-0c5a-4f53-a2dc-abfa9f00749a service nova] Creating event network-changed:31d78f4e-5b71-4dd8-81c6-5f0651a00247 for instance 2283b227-4655-4c28-9ceb-e725ac71fcb9 on hv-cinder-84330 Jun 30 10:11:00.505769 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [req-7c1bd6e1-4a5f-4a63-b644-30e9a6d1fd0b req-6da93e35-0c5a-4f53-a2dc-abfa9f00749a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030030 Jun 30 10:11:00.506463 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 504/1022] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:11:00.695455 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-2e0f4be9-d18e-4424-8582-d43cff9b668e tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] Calling method '.version_select at 0x7fc22039d430>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:11:00.726036 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-2e0f4be9-d18e-4424-8582-d43cff9b668e tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/304567b5-a9a8-4531-a2f0-13d6e9fb28cb" status: 200 len: 287 microversion: 2.1 time: 0.035064 Jun 30 10:11:00.726598 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 519/1023] 10.222.0.16 () {58 vars in 1250 bytes} [Thu Jun 30 10:11:00 2022] GET /compute/v2.1/os-snapshots/304567b5-a9a8-4531-a2f0-13d6e9fb28cb => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:11:01.743662 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-5b770b70-27d5-4e0f-8f3d-4c0bf1de092e tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] Calling method '.version_select at 0x7fc224ad6820>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:11:01.775859 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-5b770b70-27d5-4e0f-8f3d-4c0bf1de092e tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/304567b5-a9a8-4531-a2f0-13d6e9fb28cb" status: 200 len: 287 microversion: 2.1 time: 0.039866 Jun 30 10:11:01.776431 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 505/1024] 10.222.0.16 () {58 vars in 1250 bytes} [Thu Jun 30 10:11:01 2022] GET /compute/v2.1/os-snapshots/304567b5-a9a8-4531-a2f0-13d6e9fb28cb => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:11:02.789700 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-d13493e4-24da-4dff-8b89-7120d428ac76 tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] Calling method '.version_select at 0x7fc220367af0>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:11:02.825451 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-d13493e4-24da-4dff-8b89-7120d428ac76 tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/304567b5-a9a8-4531-a2f0-13d6e9fb28cb" status: 200 len: 288 microversion: 2.1 time: 0.041118 Jun 30 10:11:02.827004 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 520/1025] 10.222.0.16 () {58 vars in 1250 bytes} [Thu Jun 30 10:11:02 2022] GET /compute/v2.1/os-snapshots/304567b5-a9a8-4531-a2f0-13d6e9fb28cb => generated 288 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:11:02.838061 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-9cf82486-c77c-4304-b098-89171de7c417 tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] Calling method '.version_select at 0x7fc224ba3dc0>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:11:02.902427 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-9cf82486-c77c-4304-b098-89171de7c417 tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/304567b5-a9a8-4531-a2f0-13d6e9fb28cb" status: 202 len: 0 microversion: 2.1 time: 0.068639 Jun 30 10:11:02.903129 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 506/1026] 10.222.0.16 () {58 vars in 1253 bytes} [Thu Jun 30 10:11:02 2022] DELETE /compute/v2.1/os-snapshots/304567b5-a9a8-4531-a2f0-13d6e9fb28cb => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:11:02.912712 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-4dc90197-db71-42b1-a0b6-35a2857af0b8 tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] Calling method '.version_select at 0x7fc2203f2430>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:11:02.945005 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-4dc90197-db71-42b1-a0b6-35a2857af0b8 tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/304567b5-a9a8-4531-a2f0-13d6e9fb28cb" status: 200 len: 287 microversion: 2.1 time: 0.036922 Jun 30 10:11:02.945554 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 521/1027] 10.222.0.16 () {58 vars in 1250 bytes} [Thu Jun 30 10:11:02 2022] GET /compute/v2.1/os-snapshots/304567b5-a9a8-4531-a2f0-13d6e9fb28cb => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:11:03.958152 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-948ecbd6-6653-4791-b3f1-5b43e2096e11 tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] Calling method '.version_select at 0x7fc224c20b80>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:11:03.985611 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.wsgi [None req-948ecbd6-6653-4791-b3f1-5b43e2096e11 tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] HTTP exception thrown: Snapshot 304567b5-a9a8-4531-a2f0-13d6e9fb28cb could not be found. Jun 30 10:11:03.988031 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-948ecbd6-6653-4791-b3f1-5b43e2096e11 tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] Request method failure captured: Jun 30 10:11:03.988031 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: request: GET /compute/v2.1/os-snapshots/304567b5-a9a8-4531-a2f0-13d6e9fb28cb HTTP/1.1 Jun 30 10:11:03.988031 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept: application/json Jun 30 10:11:03.988031 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept-Encoding: identity Jun 30 10:11:03.988031 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Connection: close Jun 30 10:11:03.988031 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Length: 0 Jun 30 10:11:03.988031 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Type: application/json Jun 30 10:11:03.988031 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Host: 10.222.0.16 Jun 30 10:11:03.988031 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Openstack-System-Scope: None Jun 30 10:11:03.988031 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: User-Agent: python-urllib3/1.26.9 Jun 30 10:11:03.988031 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Auth-Token: gAAAAABivXax5JZlzX-xpsJcJdTw2vPlvvGlAIvBpzTfhWC8gTDKR6p_tcTZsyLfY7IU2gAC8Nxa_pXDNSiRHwDF-PgSYDi6f7sG_Arzw26tQeSeCMGloEvxT3kcMaBsx2-XLh0sR4hiaDU4l7rbsTKfkmfx0q6hm0n7pdFandVs8Gp4aDIjIIc Jun 30 10:11:03.988031 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Id: None Jun 30 10:11:03.988031 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Name: None Jun 30 10:11:03.988031 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Identity-Status: Confirmed Jun 30 10:11:03.988031 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Is-Admin-Project: True Jun 30 10:11:03.988031 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Id: default Jun 30 10:11:03.988031 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Name: Default Jun 30 10:11:03.988031 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Id: c7304ecf653042e4914899798cfcdee5 Jun 30 10:11:03.988031 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-450765708 Jun 30 10:11:03.988031 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Role: reader,member Jun 30 10:11:03.988031 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Roles: reader,member Jun 30 10:11:03.989646 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c7304ecf653042e4914899798cfcdee5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c7304ecf653042e4914899798cfcdee5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c7304ecf653042e4914899798cfcdee5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c7304ecf653042e4914899798cfcdee5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:11:03.989646 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant: tempest-VolumesSnapshotsTestJSON-450765708 Jun 30 10:11:03.989646 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Id: c7304ecf653042e4914899798cfcdee5 Jun 30 10:11:03.989646 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-450765708 Jun 30 10:11:03.989646 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User: tempest-VolumesSnapshotsTestJSON-450765708-project Jun 30 10:11:03.989646 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Id: default Jun 30 10:11:03.989646 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Name: Default Jun 30 10:11:03.989646 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Id: 1de745cdb7ab41eca04241cb49aff875 Jun 30 10:11:03.989646 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Name: tempest-VolumesSnapshotsTestJSON-450765708-project Jun 30 10:11:03.989646 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: method: Jun 30 10:11:03.989646 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: exception: Snapshot 304567b5-a9a8-4531-a2f0-13d6e9fb28cb could not be found. Jun 30 10:11:03.989646 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: action_args: {'id': '304567b5-a9a8-4531-a2f0-13d6e9fb28cb'} Jun 30 10:11:03.989646 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:11:03.990579 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:11:03.990579 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 30 10:11:03.990579 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 30 10:11:03.990579 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 30 10:11:03.990579 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 30 10:11:03.990579 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 30 10:11:03.990579 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 30 10:11:03.990579 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 10:11:03.990579 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 10:11:03.990579 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 10:11:03.990579 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 10:11:03.990579 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 10:11:03.990579 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 10:11:03.990579 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 10:11:03.990579 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 10:11:03.990579 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 304567b5-a9a8-4531-a2f0-13d6e9fb28cb could not be found. (HTTP 404) (Request-ID: req-d693a60a-4104-46da-8d43-4ac2ed2b4eeb) Jun 30 10:11:03.990579 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:11:03.990579 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:11:03.991753 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:11:03.991753 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:11:03.991753 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 30 10:11:03.991753 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 30 10:11:03.991753 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 10:11:03.991753 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 10:11:03.991753 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 30 10:11:03.991753 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 30 10:11:03.991753 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 10:11:03.991753 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 10:11:03.991753 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 30 10:11:03.991753 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 30 10:11:03.991753 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 30 10:11:03.991753 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 30 10:11:03.991753 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 30 10:11:03.991753 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 30 10:11:03.991753 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 10:11:03.991753 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 10:11:03.991753 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 10:11:03.992994 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 10:11:03.992994 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 10:11:03.992994 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 10:11:03.992994 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 10:11:03.992994 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 10:11:03.992994 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 304567b5-a9a8-4531-a2f0-13d6e9fb28cb could not be found. Jun 30 10:11:03.992994 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:11:03.992994 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:11:03.992994 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:11:03.992994 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:11:03.992994 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:11:03.992994 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:11:03.992994 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:11:03.992994 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:11:03.992994 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 10:11:03.992994 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 10:11:03.992994 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:11:03.992994 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:11:03.992994 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 30 10:11:03.992994 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:11:03.994266 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 304567b5-a9a8-4531-a2f0-13d6e9fb28cb could not be found. Jun 30 10:11:03.994266 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:11:03.994266 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:11:03.994266 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:11:03.994266 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:11:03.994266 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:11:03.994266 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:11:03.994266 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:11:03.994266 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:11:03.994266 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 304567b5-a9a8-4531-a2f0-13d6e9fb28cb could not be found. Jun 30 10:11:03.994266 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:11:03.994266 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-948ecbd6-6653-4791-b3f1-5b43e2096e11 tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] Returning 404 to user: Snapshot 304567b5-a9a8-4531-a2f0-13d6e9fb28cb could not be found. {{(pid=117847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:11:03.994266 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-948ecbd6-6653-4791-b3f1-5b43e2096e11 tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/304567b5-a9a8-4531-a2f0-13d6e9fb28cb" status: 404 len: 111 microversion: 2.1 time: 0.036042 Jun 30 10:11:03.995342 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 507/1028] 10.222.0.16 () {58 vars in 1250 bytes} [Thu Jun 30 10:11:03 2022] GET /compute/v2.1/os-snapshots/304567b5-a9a8-4531-a2f0-13d6e9fb28cb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:11:04.000396 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-0a5bbed6-64d6-462f-9d18-5621b713e923 tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] Calling method '.version_select at 0x7fc22039d670>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:11:04.075789 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-0a5bbed6-64d6-462f-9d18-5621b713e923 tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/ce24d9c8-9587-495e-add0-919573ff686f" status: 202 len: 0 microversion: 2.1 time: 0.081157 Jun 30 10:11:04.076412 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 522/1029] 10.222.0.16 () {58 vars in 1247 bytes} [Thu Jun 30 10:11:03 2022] DELETE /compute/v2.1/os-volumes/ce24d9c8-9587-495e-add0-919573ff686f => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:11:04.085146 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-4f44db0f-177c-44e9-8325-3f9c1ded1791 tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] Calling method '.version_select at 0x7fc224ba3940>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:11:04.135811 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-4f44db0f-177c-44e9-8325-3f9c1ded1791 tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/ce24d9c8-9587-495e-add0-919573ff686f" status: 200 len: 343 microversion: 2.1 time: 0.054549 Jun 30 10:11:04.136431 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 508/1030] 10.222.0.16 () {58 vars in 1244 bytes} [Thu Jun 30 10:11:04 2022] GET /compute/v2.1/os-volumes/ce24d9c8-9587-495e-add0-919573ff686f => generated 343 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:11:05.152108 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-debfc9ed-d1c4-4476-883e-95b27fb59f2a tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] Calling method '.version_select at 0x7fc2203f2ca0>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:11:05.185896 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-debfc9ed-d1c4-4476-883e-95b27fb59f2a tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] HTTP exception thrown: Volume ce24d9c8-9587-495e-add0-919573ff686f could not be found. Jun 30 10:11:05.187990 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-debfc9ed-d1c4-4476-883e-95b27fb59f2a tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] Request method failure captured: Jun 30 10:11:05.187990 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: request: GET /compute/v2.1/os-volumes/ce24d9c8-9587-495e-add0-919573ff686f HTTP/1.1 Jun 30 10:11:05.187990 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept: application/json Jun 30 10:11:05.187990 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jun 30 10:11:05.187990 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Connection: close Jun 30 10:11:05.187990 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jun 30 10:11:05.187990 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jun 30 10:11:05.187990 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Host: 10.222.0.16 Jun 30 10:11:05.187990 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jun 30 10:11:05.187990 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jun 30 10:11:05.187990 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABivXax5JZlzX-xpsJcJdTw2vPlvvGlAIvBpzTfhWC8gTDKR6p_tcTZsyLfY7IU2gAC8Nxa_pXDNSiRHwDF-PgSYDi6f7sG_Arzw26tQeSeCMGloEvxT3kcMaBsx2-XLh0sR4hiaDU4l7rbsTKfkmfx0q6hm0n7pdFandVs8Gp4aDIjIIc Jun 30 10:11:05.187990 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jun 30 10:11:05.187990 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jun 30 10:11:05.187990 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jun 30 10:11:05.187990 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jun 30 10:11:05.187990 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jun 30 10:11:05.187990 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jun 30 10:11:05.187990 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Id: c7304ecf653042e4914899798cfcdee5 Jun 30 10:11:05.187990 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-450765708 Jun 30 10:11:05.187990 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Role: reader,member Jun 30 10:11:05.187990 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Roles: reader,member Jun 30 10:11:05.189584 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c7304ecf653042e4914899798cfcdee5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c7304ecf653042e4914899798cfcdee5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c7304ecf653042e4914899798cfcdee5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c7304ecf653042e4914899798cfcdee5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:11:05.189584 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-VolumesSnapshotsTestJSON-450765708 Jun 30 10:11:05.189584 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Id: c7304ecf653042e4914899798cfcdee5 Jun 30 10:11:05.189584 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-450765708 Jun 30 10:11:05.189584 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User: tempest-VolumesSnapshotsTestJSON-450765708-project Jun 30 10:11:05.189584 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jun 30 10:11:05.189584 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jun 30 10:11:05.189584 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Id: 1de745cdb7ab41eca04241cb49aff875 Jun 30 10:11:05.189584 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-VolumesSnapshotsTestJSON-450765708-project Jun 30 10:11:05.189584 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: method: Jun 30 10:11:05.189584 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: exception: Volume ce24d9c8-9587-495e-add0-919573ff686f could not be found. Jun 30 10:11:05.189584 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: action_args: {'id': 'ce24d9c8-9587-495e-add0-919573ff686f'} Jun 30 10:11:05.189584 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:11:05.190681 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:11:05.190681 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 10:11:05.190681 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 10:11:05.190681 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 10:11:05.190681 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 10:11:05.190681 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 10:11:05.190681 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 10:11:05.190681 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 10:11:05.190681 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 10:11:05.190681 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 10:11:05.190681 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 10:11:05.190681 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 10:11:05.190681 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 10:11:05.190681 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 10:11:05.190681 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 10:11:05.190681 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ce24d9c8-9587-495e-add0-919573ff686f could not be found. (HTTP 404) (Request-ID: req-0ce9a385-a92f-4aae-9308-47b45db833f4) Jun 30 10:11:05.190681 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:11:05.190681 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:11:05.190681 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:11:05.192451 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:11:05.192451 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 30 10:11:05.192451 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 30 10:11:05.192451 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 10:11:05.192451 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 10:11:05.192451 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 10:11:05.192451 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 10:11:05.192451 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 10:11:05.192451 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 10:11:05.192451 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 10:11:05.192451 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 10:11:05.192451 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 10:11:05.192451 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 10:11:05.192451 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 10:11:05.192451 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 10:11:05.192451 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 10:11:05.192451 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 10:11:05.192451 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 10:11:05.192451 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 10:11:05.194684 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 10:11:05.194684 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 10:11:05.194684 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 10:11:05.194684 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 10:11:05.194684 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ce24d9c8-9587-495e-add0-919573ff686f could not be found. Jun 30 10:11:05.194684 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:11:05.194684 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:11:05.194684 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:11:05.194684 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:11:05.194684 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:11:05.194684 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:11:05.194684 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:11:05.194684 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:11:05.194684 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 10:11:05.194684 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 10:11:05.194684 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:11:05.194684 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:11:05.194684 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 30 10:11:05.194684 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:11:05.196317 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ce24d9c8-9587-495e-add0-919573ff686f could not be found. Jun 30 10:11:05.196317 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:11:05.196317 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:11:05.196317 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:11:05.196317 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:11:05.196317 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:11:05.196317 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:11:05.196317 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:11:05.196317 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:11:05.196317 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ce24d9c8-9587-495e-add0-919573ff686f could not be found. Jun 30 10:11:05.196317 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:11:05.196317 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-debfc9ed-d1c4-4476-883e-95b27fb59f2a tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] Returning 404 to user: Volume ce24d9c8-9587-495e-add0-919573ff686f could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:11:05.196317 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-debfc9ed-d1c4-4476-883e-95b27fb59f2a tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/ce24d9c8-9587-495e-add0-919573ff686f" status: 404 len: 109 microversion: 2.1 time: 0.043643 Jun 30 10:11:05.196317 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 523/1031] 10.222.0.16 () {58 vars in 1244 bytes} [Thu Jun 30 10:11:05 2022] GET /compute/v2.1/os-volumes/ce24d9c8-9587-495e-add0-919573ff686f => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:11:05.205365 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-ad3d127c-45d7-499d-9610-60b01bca8719 tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] Calling method '.version_select at 0x7fc224c42280>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:11:05.234330 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.wsgi [None req-ad3d127c-45d7-499d-9610-60b01bca8719 tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] HTTP exception thrown: Volume ce24d9c8-9587-495e-add0-919573ff686f could not be found. Jun 30 10:11:05.236347 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-ad3d127c-45d7-499d-9610-60b01bca8719 tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] Request method failure captured: Jun 30 10:11:05.236347 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: request: DELETE /compute/v2.1/os-volumes/ce24d9c8-9587-495e-add0-919573ff686f HTTP/1.1 Jun 30 10:11:05.236347 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept: application/json Jun 30 10:11:05.236347 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept-Encoding: identity Jun 30 10:11:05.236347 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Connection: close Jun 30 10:11:05.236347 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Length: 0 Jun 30 10:11:05.236347 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Type: application/json Jun 30 10:11:05.236347 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Host: 10.222.0.16 Jun 30 10:11:05.236347 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Openstack-System-Scope: None Jun 30 10:11:05.236347 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: User-Agent: python-urllib3/1.26.9 Jun 30 10:11:05.236347 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Auth-Token: gAAAAABivXax5JZlzX-xpsJcJdTw2vPlvvGlAIvBpzTfhWC8gTDKR6p_tcTZsyLfY7IU2gAC8Nxa_pXDNSiRHwDF-PgSYDi6f7sG_Arzw26tQeSeCMGloEvxT3kcMaBsx2-XLh0sR4hiaDU4l7rbsTKfkmfx0q6hm0n7pdFandVs8Gp4aDIjIIc Jun 30 10:11:05.236347 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Id: None Jun 30 10:11:05.236347 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Name: None Jun 30 10:11:05.236347 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Identity-Status: Confirmed Jun 30 10:11:05.236347 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Is-Admin-Project: True Jun 30 10:11:05.236347 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Id: default Jun 30 10:11:05.236347 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Name: Default Jun 30 10:11:05.236347 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Id: c7304ecf653042e4914899798cfcdee5 Jun 30 10:11:05.236347 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-450765708 Jun 30 10:11:05.236347 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Role: reader,member Jun 30 10:11:05.236347 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Roles: reader,member Jun 30 10:11:05.237983 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c7304ecf653042e4914899798cfcdee5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c7304ecf653042e4914899798cfcdee5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c7304ecf653042e4914899798cfcdee5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c7304ecf653042e4914899798cfcdee5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:11:05.237983 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant: tempest-VolumesSnapshotsTestJSON-450765708 Jun 30 10:11:05.237983 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Id: c7304ecf653042e4914899798cfcdee5 Jun 30 10:11:05.237983 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-450765708 Jun 30 10:11:05.237983 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User: tempest-VolumesSnapshotsTestJSON-450765708-project Jun 30 10:11:05.237983 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Id: default Jun 30 10:11:05.237983 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Name: Default Jun 30 10:11:05.237983 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Id: 1de745cdb7ab41eca04241cb49aff875 Jun 30 10:11:05.237983 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Name: tempest-VolumesSnapshotsTestJSON-450765708-project Jun 30 10:11:05.237983 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: method: Jun 30 10:11:05.237983 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: exception: Volume ce24d9c8-9587-495e-add0-919573ff686f could not be found. Jun 30 10:11:05.237983 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: action_args: {'id': 'ce24d9c8-9587-495e-add0-919573ff686f'} Jun 30 10:11:05.237983 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:11:05.239099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:11:05.239099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 10:11:05.239099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 10:11:05.239099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 10:11:05.239099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 10:11:05.239099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 10:11:05.239099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 10:11:05.239099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 10:11:05.239099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 10:11:05.239099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 10:11:05.239099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 10:11:05.239099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 10:11:05.239099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 10:11:05.239099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 10:11:05.239099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 10:11:05.239099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ce24d9c8-9587-495e-add0-919573ff686f could not be found. (HTTP 404) (Request-ID: req-d74e7c93-987f-4d33-be4f-611294705b54) Jun 30 10:11:05.239099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:11:05.239099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:11:05.239099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:11:05.240542 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:11:05.240542 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 30 10:11:05.240542 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 30 10:11:05.240542 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 10:11:05.240542 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 10:11:05.240542 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 10:11:05.240542 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 10:11:05.240542 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 10:11:05.240542 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 10:11:05.240542 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 10:11:05.240542 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 10:11:05.240542 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 10:11:05.240542 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 10:11:05.240542 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 10:11:05.240542 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 10:11:05.240542 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 10:11:05.240542 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 10:11:05.240542 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 10:11:05.240542 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 10:11:05.241993 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 10:11:05.241993 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 10:11:05.241993 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 10:11:05.241993 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 10:11:05.241993 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ce24d9c8-9587-495e-add0-919573ff686f could not be found. Jun 30 10:11:05.241993 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:11:05.241993 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:11:05.241993 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:11:05.241993 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:11:05.241993 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:11:05.241993 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:11:05.241993 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:11:05.241993 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:11:05.241993 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 10:11:05.241993 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 10:11:05.241993 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:11:05.241993 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:11:05.241993 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 30 10:11:05.241993 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:11:05.243541 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ce24d9c8-9587-495e-add0-919573ff686f could not be found. Jun 30 10:11:05.243541 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:11:05.243541 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:11:05.243541 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:11:05.243541 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:11:05.243541 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:11:05.243541 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:11:05.243541 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:11:05.243541 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:11:05.243541 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ce24d9c8-9587-495e-add0-919573ff686f could not be found. Jun 30 10:11:05.243541 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:11:05.243541 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-ad3d127c-45d7-499d-9610-60b01bca8719 tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] Returning 404 to user: Volume ce24d9c8-9587-495e-add0-919573ff686f could not be found. {{(pid=117847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:11:05.243541 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-ad3d127c-45d7-499d-9610-60b01bca8719 tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/ce24d9c8-9587-495e-add0-919573ff686f" status: 404 len: 109 microversion: 2.1 time: 0.037610 Jun 30 10:11:05.243541 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 509/1032] 10.222.0.16 () {58 vars in 1247 bytes} [Thu Jun 30 10:11:05 2022] DELETE /compute/v2.1/os-volumes/ce24d9c8-9587-495e-add0-919573ff686f => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:11:05.247315 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f6c940b0-e26c-418b-ab61-6f10e1ac1927 tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] Calling method '.version_select at 0x7fc2201fa550>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:11:05.280756 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-f6c940b0-e26c-418b-ab61-6f10e1ac1927 tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] HTTP exception thrown: Volume ce24d9c8-9587-495e-add0-919573ff686f could not be found. Jun 30 10:11:05.282775 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f6c940b0-e26c-418b-ab61-6f10e1ac1927 tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] Request method failure captured: Jun 30 10:11:05.282775 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: request: GET /compute/v2.1/os-volumes/ce24d9c8-9587-495e-add0-919573ff686f HTTP/1.1 Jun 30 10:11:05.282775 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept: application/json Jun 30 10:11:05.282775 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jun 30 10:11:05.282775 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Connection: close Jun 30 10:11:05.282775 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jun 30 10:11:05.282775 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jun 30 10:11:05.282775 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Host: 10.222.0.16 Jun 30 10:11:05.282775 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jun 30 10:11:05.282775 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jun 30 10:11:05.282775 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABivXax5JZlzX-xpsJcJdTw2vPlvvGlAIvBpzTfhWC8gTDKR6p_tcTZsyLfY7IU2gAC8Nxa_pXDNSiRHwDF-PgSYDi6f7sG_Arzw26tQeSeCMGloEvxT3kcMaBsx2-XLh0sR4hiaDU4l7rbsTKfkmfx0q6hm0n7pdFandVs8Gp4aDIjIIc Jun 30 10:11:05.282775 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jun 30 10:11:05.282775 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jun 30 10:11:05.282775 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jun 30 10:11:05.282775 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jun 30 10:11:05.282775 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jun 30 10:11:05.282775 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jun 30 10:11:05.282775 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Id: c7304ecf653042e4914899798cfcdee5 Jun 30 10:11:05.282775 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-450765708 Jun 30 10:11:05.282775 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Role: reader,member Jun 30 10:11:05.282775 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Roles: reader,member Jun 30 10:11:05.284435 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c7304ecf653042e4914899798cfcdee5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c7304ecf653042e4914899798cfcdee5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c7304ecf653042e4914899798cfcdee5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c7304ecf653042e4914899798cfcdee5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:11:05.284435 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-VolumesSnapshotsTestJSON-450765708 Jun 30 10:11:05.284435 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Id: c7304ecf653042e4914899798cfcdee5 Jun 30 10:11:05.284435 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-450765708 Jun 30 10:11:05.284435 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User: tempest-VolumesSnapshotsTestJSON-450765708-project Jun 30 10:11:05.284435 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jun 30 10:11:05.284435 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jun 30 10:11:05.284435 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Id: 1de745cdb7ab41eca04241cb49aff875 Jun 30 10:11:05.284435 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-VolumesSnapshotsTestJSON-450765708-project Jun 30 10:11:05.284435 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: method: Jun 30 10:11:05.284435 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: exception: Volume ce24d9c8-9587-495e-add0-919573ff686f could not be found. Jun 30 10:11:05.284435 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: action_args: {'id': 'ce24d9c8-9587-495e-add0-919573ff686f'} Jun 30 10:11:05.284435 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:11:05.285388 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:11:05.285388 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 10:11:05.285388 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 10:11:05.285388 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 10:11:05.285388 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 10:11:05.285388 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 10:11:05.285388 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 10:11:05.285388 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 10:11:05.285388 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 10:11:05.285388 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 10:11:05.285388 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 10:11:05.285388 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 10:11:05.285388 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 10:11:05.285388 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 10:11:05.285388 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 10:11:05.285388 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ce24d9c8-9587-495e-add0-919573ff686f could not be found. (HTTP 404) (Request-ID: req-f370e8e0-935d-4b13-bafb-d958efbe30fb) Jun 30 10:11:05.285388 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:11:05.285388 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:11:05.285388 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:11:05.286779 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:11:05.286779 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 30 10:11:05.286779 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 30 10:11:05.286779 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 10:11:05.286779 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 10:11:05.286779 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 10:11:05.286779 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 10:11:05.286779 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 10:11:05.286779 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 10:11:05.286779 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 10:11:05.286779 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 10:11:05.286779 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 10:11:05.286779 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 10:11:05.286779 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 10:11:05.286779 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 10:11:05.286779 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 10:11:05.286779 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 10:11:05.286779 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 10:11:05.286779 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 10:11:05.288217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 10:11:05.288217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 10:11:05.288217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 10:11:05.288217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 10:11:05.288217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ce24d9c8-9587-495e-add0-919573ff686f could not be found. Jun 30 10:11:05.288217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:11:05.288217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:11:05.288217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:11:05.288217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:11:05.288217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:11:05.288217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:11:05.288217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:11:05.288217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:11:05.288217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 10:11:05.288217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 10:11:05.288217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:11:05.288217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:11:05.288217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 30 10:11:05.288217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:11:05.289692 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ce24d9c8-9587-495e-add0-919573ff686f could not be found. Jun 30 10:11:05.289692 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:11:05.289692 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:11:05.289692 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:11:05.289692 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:11:05.289692 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:11:05.289692 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:11:05.289692 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:11:05.289692 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:11:05.289692 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ce24d9c8-9587-495e-add0-919573ff686f could not be found. Jun 30 10:11:05.289692 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:11:05.289692 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f6c940b0-e26c-418b-ab61-6f10e1ac1927 tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] Returning 404 to user: Volume ce24d9c8-9587-495e-add0-919573ff686f could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:11:05.289692 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f6c940b0-e26c-418b-ab61-6f10e1ac1927 tempest-VolumesSnapshotsTestJSON-450765708 tempest-VolumesSnapshotsTestJSON-450765708-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/ce24d9c8-9587-495e-add0-919573ff686f" status: 404 len: 109 microversion: 2.1 time: 0.040896 Jun 30 10:11:05.289692 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 524/1033] 10.222.0.16 () {58 vars in 1244 bytes} [Thu Jun 30 10:11:05 2022] GET /compute/v2.1/os-volumes/ce24d9c8-9587-495e-add0-919573ff686f => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:11:43.984919 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_api:SELECT=9 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:11:43.985662 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell1:SELECT=25 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:11:43.989888 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-92f87ed2-4546-467b-b696-d7fa4ee0a3de tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-972327694", "imageRef": "c9dccba6-70d7-4aa8-9b8f-9c88ef1af443", "flavorRef": "452"}} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:11:44.048955 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.network.neutron [None req-92f87ed2-4546-467b-b696-d7fa4ee0a3de tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] validate_networks() for None {{(pid=117847) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 10:11:44.329853 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-92f87ed2-4546-467b-b696-d7fa4ee0a3de tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Flavor limits 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 10:11:44.330272 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-92f87ed2-4546-467b-b696-d7fa4ee0a3de tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Image limits 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 10:11:44.330769 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-92f87ed2-4546-467b-b696-d7fa4ee0a3de tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Flavor pref 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 10:11:44.331171 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-92f87ed2-4546-467b-b696-d7fa4ee0a3de tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Image pref 0:0:0 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 10:11:44.331574 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.virt.hardware [None req-92f87ed2-4546-467b-b696-d7fa4ee0a3de tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117847) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 10:11:44.341529 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-92f87ed2-4546-467b-b696-d7fa4ee0a3de tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:44.342129 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-92f87ed2-4546-467b-b696-d7fa4ee0a3de tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:44.343021 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-92f87ed2-4546-467b-b696-d7fa4ee0a3de tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:44.343550 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-92f87ed2-4546-467b-b696-d7fa4ee0a3de tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:44.361099 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.quota [None req-92f87ed2-4546-467b-b696-d7fa4ee0a3de tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Getting quotas for project 12b12537f14f4f56b0b2b5b65ca459a7. Resources: {'ram', 'instances', 'cores'} {{(pid=117847) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 10:11:44.365667 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.quota [None req-92f87ed2-4546-467b-b696-d7fa4ee0a3de tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Getting quotas for user 44e759dcbb0a4b57b13449ed7b195b2e and project 12b12537f14f4f56b0b2b5b65ca459a7. Resources: {'ram', 'instances', 'cores'} {{(pid=117847) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 10:11:44.377748 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-92f87ed2-4546-467b-b696-d7fa4ee0a3de tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Going to run 1 instances... {{(pid=117847) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 10:11:44.380130 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-92f87ed2-4546-467b-b696-d7fa4ee0a3de tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] [instance: 49257fa9-91e5-4513-8da9-e3114f577453] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9dccba6-70d7-4aa8-9b8f-9c88ef1af443',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117847) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 10:11:44.428479 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-92f87ed2-4546-467b-b696-d7fa4ee0a3de tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.444602 Jun 30 10:11:44.429088 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 510/1034] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jun 30 10:11:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 446 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 10:11:44.436888 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=5 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:11:44.437658 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=30 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:11:44.441879 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-273230b4-ae96-45d3-a739-594b374bc357 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:11:44.442489 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-273230b4-ae96-45d3-a739-594b374bc357 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] [instance: 49257fa9-91e5-4513-8da9-e3114f577453] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:11:44.496583 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-273230b4-ae96-45d3-a739-594b374bc357 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e759dcbb0a4b57b13449ed7b195b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b12537f14f4f56b0b2b5b65ca459a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:11:44.503326 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-273230b4-ae96-45d3-a739-594b374bc357 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] 10.222.0.16 "GET /compute/v2.1/servers/49257fa9-91e5-4513-8da9-e3114f577453" status: 200 len: 1214 microversion: 2.1 time: 0.067959 Jun 30 10:11:44.503914 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 525/1035] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:11:44 2022] GET /compute/v2.1/servers/49257fa9-91e5-4513-8da9-e3114f577453 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:11:45.522709 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-a26f39b1-5ccd-48dc-b35e-a514c4051a13 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:11:45.523344 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-a26f39b1-5ccd-48dc-b35e-a514c4051a13 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] [instance: 49257fa9-91e5-4513-8da9-e3114f577453] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:11:45.545245 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a26f39b1-5ccd-48dc-b35e-a514c4051a13 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:45.545715 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a26f39b1-5ccd-48dc-b35e-a514c4051a13 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:45.546490 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a26f39b1-5ccd-48dc-b35e-a514c4051a13 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:45.546967 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a26f39b1-5ccd-48dc-b35e-a514c4051a13 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:45.620872 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-a26f39b1-5ccd-48dc-b35e-a514c4051a13 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e759dcbb0a4b57b13449ed7b195b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b12537f14f4f56b0b2b5b65ca459a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:11:45.630008 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-a26f39b1-5ccd-48dc-b35e-a514c4051a13 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] 10.222.0.16 "GET /compute/v2.1/servers/49257fa9-91e5-4513-8da9-e3114f577453" status: 200 len: 1274 microversion: 2.1 time: 0.112843 Jun 30 10:11:45.632235 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 511/1036] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:11:45 2022] GET /compute/v2.1/servers/49257fa9-91e5-4513-8da9-e3114f577453 => generated 1274 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:11:46.652938 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-d7f521df-1283-408f-b8e3-d2e0a0c2352f tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:11:46.653525 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-d7f521df-1283-408f-b8e3-d2e0a0c2352f tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] [instance: 49257fa9-91e5-4513-8da9-e3114f577453] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:11:46.660433 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d7f521df-1283-408f-b8e3-d2e0a0c2352f tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:46.660878 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d7f521df-1283-408f-b8e3-d2e0a0c2352f tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:46.661640 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d7f521df-1283-408f-b8e3-d2e0a0c2352f tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:46.662065 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d7f521df-1283-408f-b8e3-d2e0a0c2352f tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:46.869827 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-d7f521df-1283-408f-b8e3-d2e0a0c2352f tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e759dcbb0a4b57b13449ed7b195b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b12537f14f4f56b0b2b5b65ca459a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:11:46.877981 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-d7f521df-1283-408f-b8e3-d2e0a0c2352f tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] 10.222.0.16 "GET /compute/v2.1/servers/49257fa9-91e5-4513-8da9-e3114f577453" status: 200 len: 1314 microversion: 2.1 time: 0.229040 Jun 30 10:11:46.878836 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 526/1037] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:11:46 2022] GET /compute/v2.1/servers/49257fa9-91e5-4513-8da9-e3114f577453 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:11:47.275906 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [req-19a54ec7-90ff-4b4d-a405-bd7764978247 req-ab44411a-560d-43e0-a918-9bb9b2e49c50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49257fa9-91e5-4513-8da9-e3114f577453", "tag": "3899e648-fd7d-44be-a916-4a31ca98b140"}]} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:11:47.284522 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-19a54ec7-90ff-4b4d-a405-bd7764978247 req-ab44411a-560d-43e0-a918-9bb9b2e49c50 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:47.284877 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-19a54ec7-90ff-4b4d-a405-bd7764978247 req-ab44411a-560d-43e0-a918-9bb9b2e49c50 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:47.297515 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.compute.server_external_events [req-19a54ec7-90ff-4b4d-a405-bd7764978247 req-ab44411a-560d-43e0-a918-9bb9b2e49c50 service nova] Creating event network-changed:3899e648-fd7d-44be-a916-4a31ca98b140 for instance 49257fa9-91e5-4513-8da9-e3114f577453 on hv-cinder-84330 Jun 30 10:11:47.303048 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [req-19a54ec7-90ff-4b4d-a405-bd7764978247 req-ab44411a-560d-43e0-a918-9bb9b2e49c50 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190735 Jun 30 10:11:47.303648 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 512/1038] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:11:47.895802 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-50e62eea-9f0b-4883-a56b-968df1b8ea9e tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:11:47.896515 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-50e62eea-9f0b-4883-a56b-968df1b8ea9e tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] [instance: 49257fa9-91e5-4513-8da9-e3114f577453] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:11:47.903760 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-50e62eea-9f0b-4883-a56b-968df1b8ea9e tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:47.904225 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-50e62eea-9f0b-4883-a56b-968df1b8ea9e tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:47.904974 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-50e62eea-9f0b-4883-a56b-968df1b8ea9e tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:47.905396 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-50e62eea-9f0b-4883-a56b-968df1b8ea9e tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:48.039131 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-50e62eea-9f0b-4883-a56b-968df1b8ea9e tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e759dcbb0a4b57b13449ed7b195b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b12537f14f4f56b0b2b5b65ca459a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:11:48.046697 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-50e62eea-9f0b-4883-a56b-968df1b8ea9e tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] 10.222.0.16 "GET /compute/v2.1/servers/49257fa9-91e5-4513-8da9-e3114f577453" status: 200 len: 1314 microversion: 2.1 time: 0.154870 Jun 30 10:11:48.047232 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 527/1039] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:11:47 2022] GET /compute/v2.1/servers/49257fa9-91e5-4513-8da9-e3114f577453 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:11:49.068159 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-ec8a31db-0ac6-487d-99d4-9d746575255d tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:11:49.068851 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-ec8a31db-0ac6-487d-99d4-9d746575255d tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] [instance: 49257fa9-91e5-4513-8da9-e3114f577453] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:11:49.076640 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ec8a31db-0ac6-487d-99d4-9d746575255d tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:49.077078 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ec8a31db-0ac6-487d-99d4-9d746575255d tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:49.077831 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ec8a31db-0ac6-487d-99d4-9d746575255d tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:49.078265 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ec8a31db-0ac6-487d-99d4-9d746575255d tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:49.212075 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-ec8a31db-0ac6-487d-99d4-9d746575255d tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e759dcbb0a4b57b13449ed7b195b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b12537f14f4f56b0b2b5b65ca459a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:11:49.225916 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-ec8a31db-0ac6-487d-99d4-9d746575255d tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] 10.222.0.16 "GET /compute/v2.1/servers/49257fa9-91e5-4513-8da9-e3114f577453" status: 200 len: 1314 microversion: 2.1 time: 0.164497 Jun 30 10:11:49.226527 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 513/1040] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:11:49 2022] GET /compute/v2.1/servers/49257fa9-91e5-4513-8da9-e3114f577453 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:11:50.248069 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-880daef7-4419-4770-949e-3a52b796c626 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:11:50.248687 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-880daef7-4419-4770-949e-3a52b796c626 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] [instance: 49257fa9-91e5-4513-8da9-e3114f577453] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:11:50.255537 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-880daef7-4419-4770-949e-3a52b796c626 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:50.256001 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-880daef7-4419-4770-949e-3a52b796c626 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:50.256760 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-880daef7-4419-4770-949e-3a52b796c626 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:50.257185 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-880daef7-4419-4770-949e-3a52b796c626 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:50.395395 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-880daef7-4419-4770-949e-3a52b796c626 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e759dcbb0a4b57b13449ed7b195b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b12537f14f4f56b0b2b5b65ca459a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:11:50.405596 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-880daef7-4419-4770-949e-3a52b796c626 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] 10.222.0.16 "GET /compute/v2.1/servers/49257fa9-91e5-4513-8da9-e3114f577453" status: 200 len: 1314 microversion: 2.1 time: 0.162640 Jun 30 10:11:50.406227 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 528/1041] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:11:50 2022] GET /compute/v2.1/servers/49257fa9-91e5-4513-8da9-e3114f577453 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:11:50.827660 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-fc122b68-bc94-4c56-9bd6-ad8c54cb7d5c tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:11:50.828239 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-fc122b68-bc94-4c56-9bd6-ad8c54cb7d5c tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:11:50.838359 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-fc122b68-bc94-4c56-9bd6-ad8c54cb7d5c tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:50.839009 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-fc122b68-bc94-4c56-9bd6-ad8c54cb7d5c tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:50.839822 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-fc122b68-bc94-4c56-9bd6-ad8c54cb7d5c tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:50.840284 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-fc122b68-bc94-4c56-9bd6-ad8c54cb7d5c tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:50.862986 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.objects.instance [None req-fc122b68-bc94-4c56-9bd6-ad8c54cb7d5c tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lazy-loading 'flavor' on Instance uuid 0947fb10-14c6-4e0e-ad30-45bb44422c9f {{(pid=117847) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:11:50.945351 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-fc122b68-bc94-4c56-9bd6-ad8c54cb7d5c tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "POST /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f/action" status: 202 len: 0 microversion: 2.1 time: 0.123512 Jun 30 10:11:50.945979 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 514/1042] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Jun 30 10:11:50 2022] POST /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:11:50.954562 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-57bc0ada-36d9-41f8-a94b-15e72193ae98 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:11:50.955251 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-57bc0ada-36d9-41f8-a94b-15e72193ae98 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:11:50.961101 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-57bc0ada-36d9-41f8-a94b-15e72193ae98 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:50.961541 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-57bc0ada-36d9-41f8-a94b-15e72193ae98 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:50.962301 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-57bc0ada-36d9-41f8-a94b-15e72193ae98 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:50.962760 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-57bc0ada-36d9-41f8-a94b-15e72193ae98 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:51.101128 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-57bc0ada-36d9-41f8-a94b-15e72193ae98 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc71c372e584ddf91290eefb53a973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c9f15ea7b84f54a6cfa004bd02de6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:11:51.109480 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-57bc0ada-36d9-41f8-a94b-15e72193ae98 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f" status: 200 len: 1569 microversion: 2.1 time: 0.158803 Jun 30 10:11:51.110035 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 529/1043] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:11:50 2022] GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:11:51.424699 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-c0401d45-cc8f-4b50-a0cd-15381c7370e3 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:11:51.425393 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-c0401d45-cc8f-4b50-a0cd-15381c7370e3 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] [instance: 49257fa9-91e5-4513-8da9-e3114f577453] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:11:51.432573 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c0401d45-cc8f-4b50-a0cd-15381c7370e3 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:51.433014 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c0401d45-cc8f-4b50-a0cd-15381c7370e3 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:51.433756 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c0401d45-cc8f-4b50-a0cd-15381c7370e3 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:51.434415 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-c0401d45-cc8f-4b50-a0cd-15381c7370e3 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:51.588883 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-c0401d45-cc8f-4b50-a0cd-15381c7370e3 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e759dcbb0a4b57b13449ed7b195b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b12537f14f4f56b0b2b5b65ca459a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:11:51.597366 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-c0401d45-cc8f-4b50-a0cd-15381c7370e3 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] 10.222.0.16 "GET /compute/v2.1/servers/49257fa9-91e5-4513-8da9-e3114f577453" status: 200 len: 1314 microversion: 2.1 time: 0.177830 Jun 30 10:11:51.597905 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 515/1044] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:11:51 2022] GET /compute/v2.1/servers/49257fa9-91e5-4513-8da9-e3114f577453 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:11:52.130762 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-a5e91200-f789-4180-81de-b18e1977e28f tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:11:52.131597 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-a5e91200-f789-4180-81de-b18e1977e28f tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:11:52.141623 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a5e91200-f789-4180-81de-b18e1977e28f tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:52.142064 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a5e91200-f789-4180-81de-b18e1977e28f tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:52.142865 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a5e91200-f789-4180-81de-b18e1977e28f tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:52.143264 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a5e91200-f789-4180-81de-b18e1977e28f tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:52.281543 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-a5e91200-f789-4180-81de-b18e1977e28f tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc71c372e584ddf91290eefb53a973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c9f15ea7b84f54a6cfa004bd02de6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:11:52.289505 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-a5e91200-f789-4180-81de-b18e1977e28f tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f" status: 200 len: 1569 microversion: 2.1 time: 0.165395 Jun 30 10:11:52.290077 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 530/1045] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:11:52 2022] GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:11:52.614881 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-595e27f5-cb59-4419-b577-8aac00ace109 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:11:52.615506 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-595e27f5-cb59-4419-b577-8aac00ace109 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] [instance: 49257fa9-91e5-4513-8da9-e3114f577453] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:11:52.621941 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-595e27f5-cb59-4419-b577-8aac00ace109 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:52.622387 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-595e27f5-cb59-4419-b577-8aac00ace109 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:52.623139 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-595e27f5-cb59-4419-b577-8aac00ace109 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:52.623548 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-595e27f5-cb59-4419-b577-8aac00ace109 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:52.761388 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-595e27f5-cb59-4419-b577-8aac00ace109 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e759dcbb0a4b57b13449ed7b195b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b12537f14f4f56b0b2b5b65ca459a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:11:52.771030 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-595e27f5-cb59-4419-b577-8aac00ace109 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] 10.222.0.16 "GET /compute/v2.1/servers/49257fa9-91e5-4513-8da9-e3114f577453" status: 200 len: 1314 microversion: 2.1 time: 0.160297 Jun 30 10:11:52.771783 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 516/1046] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:11:52 2022] GET /compute/v2.1/servers/49257fa9-91e5-4513-8da9-e3114f577453 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:11:52.773357 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-780a738b-6e45-4f38-9997-e28bc268bd5f req-7ef5f616-d7f0-4d9a-b42f-413f381bd5b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49257fa9-91e5-4513-8da9-e3114f577453", "name": "network-vif-plugged", "status": "completed", "tag": "3899e648-fd7d-44be-a916-4a31ca98b140"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:11:52.782073 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-780a738b-6e45-4f38-9997-e28bc268bd5f req-7ef5f616-d7f0-4d9a-b42f-413f381bd5b0 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:52.782598 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-780a738b-6e45-4f38-9997-e28bc268bd5f req-7ef5f616-d7f0-4d9a-b42f-413f381bd5b0 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:52.793598 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-780a738b-6e45-4f38-9997-e28bc268bd5f req-7ef5f616-d7f0-4d9a-b42f-413f381bd5b0 service nova] Creating event network-vif-plugged:3899e648-fd7d-44be-a916-4a31ca98b140 for instance 49257fa9-91e5-4513-8da9-e3114f577453 on hv-cinder-84330 Jun 30 10:11:52.799049 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-780a738b-6e45-4f38-9997-e28bc268bd5f req-7ef5f616-d7f0-4d9a-b42f-413f381bd5b0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099925 Jun 30 10:11:52.799626 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 531/1047] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:11:53.312506 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-42f45177-8e5e-40e3-90f5-a6053d45a40c tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:11:53.313530 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-42f45177-8e5e-40e3-90f5-a6053d45a40c tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:11:53.322936 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-42f45177-8e5e-40e3-90f5-a6053d45a40c tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:53.323784 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-42f45177-8e5e-40e3-90f5-a6053d45a40c tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:53.325021 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-42f45177-8e5e-40e3-90f5-a6053d45a40c tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:53.325611 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-42f45177-8e5e-40e3-90f5-a6053d45a40c tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:53.469741 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-42f45177-8e5e-40e3-90f5-a6053d45a40c tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc71c372e584ddf91290eefb53a973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c9f15ea7b84f54a6cfa004bd02de6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:11:53.477776 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-42f45177-8e5e-40e3-90f5-a6053d45a40c tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f" status: 200 len: 1569 microversion: 2.1 time: 0.172805 Jun 30 10:11:53.478317 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 517/1048] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:11:53 2022] GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:11:53.792170 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-73a080f5-c051-49fd-b2cb-d90410eadd48 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:11:53.792791 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-73a080f5-c051-49fd-b2cb-d90410eadd48 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] [instance: 49257fa9-91e5-4513-8da9-e3114f577453] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:11:53.800696 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-73a080f5-c051-49fd-b2cb-d90410eadd48 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:53.801190 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-73a080f5-c051-49fd-b2cb-d90410eadd48 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:53.802078 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-73a080f5-c051-49fd-b2cb-d90410eadd48 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:53.802917 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-73a080f5-c051-49fd-b2cb-d90410eadd48 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:53.943918 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-73a080f5-c051-49fd-b2cb-d90410eadd48 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e759dcbb0a4b57b13449ed7b195b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b12537f14f4f56b0b2b5b65ca459a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:11:53.951588 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-73a080f5-c051-49fd-b2cb-d90410eadd48 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] 10.222.0.16 "GET /compute/v2.1/servers/49257fa9-91e5-4513-8da9-e3114f577453" status: 200 len: 1314 microversion: 2.1 time: 0.164930 Jun 30 10:11:53.952382 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 532/1049] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:11:53 2022] GET /compute/v2.1/servers/49257fa9-91e5-4513-8da9-e3114f577453 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:11:54.498805 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-1af270ff-f53a-4e1d-9a20-12e0ad9562a7 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:11:54.499609 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-1af270ff-f53a-4e1d-9a20-12e0ad9562a7 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:11:54.502127 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell0:SELECT=2 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:11:54.502804 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell0:SELECT=6 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:11:54.509593 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1af270ff-f53a-4e1d-9a20-12e0ad9562a7 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:54.510040 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1af270ff-f53a-4e1d-9a20-12e0ad9562a7 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:54.510803 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1af270ff-f53a-4e1d-9a20-12e0ad9562a7 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:54.511265 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-1af270ff-f53a-4e1d-9a20-12e0ad9562a7 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:54.659917 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-1af270ff-f53a-4e1d-9a20-12e0ad9562a7 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc71c372e584ddf91290eefb53a973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c9f15ea7b84f54a6cfa004bd02de6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:11:54.668120 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-1af270ff-f53a-4e1d-9a20-12e0ad9562a7 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f" status: 200 len: 1569 microversion: 2.1 time: 0.175619 Jun 30 10:11:54.668901 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 518/1050] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:11:54 2022] GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:11:54.968906 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-cb911750-390c-4c3b-aecf-a5295abed606 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:11:54.969506 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-cb911750-390c-4c3b-aecf-a5295abed606 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] [instance: 49257fa9-91e5-4513-8da9-e3114f577453] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:11:54.971594 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=2 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:11:54.980070 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cb911750-390c-4c3b-aecf-a5295abed606 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:54.980734 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cb911750-390c-4c3b-aecf-a5295abed606 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:54.982018 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cb911750-390c-4c3b-aecf-a5295abed606 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:54.982753 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cb911750-390c-4c3b-aecf-a5295abed606 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:55.124059 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-cb911750-390c-4c3b-aecf-a5295abed606 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e759dcbb0a4b57b13449ed7b195b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b12537f14f4f56b0b2b5b65ca459a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:11:55.132471 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-cb911750-390c-4c3b-aecf-a5295abed606 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] 10.222.0.16 "GET /compute/v2.1/servers/49257fa9-91e5-4513-8da9-e3114f577453" status: 200 len: 1464 microversion: 2.1 time: 0.167472 Jun 30 10:11:55.133038 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 533/1051] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:11:54 2022] GET /compute/v2.1/servers/49257fa9-91e5-4513-8da9-e3114f577453 => generated 1464 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:11:55.172518 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-0f0f2088-71e6-4fbd-8aa8-5d5ece1fa98c tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:11:55.173032 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-0f0f2088-71e6-4fbd-8aa8-5d5ece1fa98c tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] [instance: 49257fa9-91e5-4513-8da9-e3114f577453] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:11:55.179344 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-0f0f2088-71e6-4fbd-8aa8-5d5ece1fa98c tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:55.179787 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-0f0f2088-71e6-4fbd-8aa8-5d5ece1fa98c tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:55.180567 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-0f0f2088-71e6-4fbd-8aa8-5d5ece1fa98c tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:55.180993 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-0f0f2088-71e6-4fbd-8aa8-5d5ece1fa98c tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:55.207382 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-0f0f2088-71e6-4fbd-8aa8-5d5ece1fa98c tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] [instance: 49257fa9-91e5-4513-8da9-e3114f577453] Going to try to terminate instance {{(pid=117847) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 10:11:55.287021 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-0f0f2088-71e6-4fbd-8aa8-5d5ece1fa98c tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] 10.222.0.16 "DELETE /compute/v2.1/servers/49257fa9-91e5-4513-8da9-e3114f577453" status: 204 len: 0 microversion: 2.1 time: 0.117754 Jun 30 10:11:55.287744 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 519/1052] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 10:11:55 2022] DELETE /compute/v2.1/servers/49257fa9-91e5-4513-8da9-e3114f577453 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 10:11:55.298236 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-4607fd10-c688-47f0-a7a6-9825d84a4293 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:11:55.298900 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-4607fd10-c688-47f0-a7a6-9825d84a4293 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] [instance: 49257fa9-91e5-4513-8da9-e3114f577453] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:11:55.305581 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4607fd10-c688-47f0-a7a6-9825d84a4293 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:55.306021 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4607fd10-c688-47f0-a7a6-9825d84a4293 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:55.306770 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4607fd10-c688-47f0-a7a6-9825d84a4293 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:55.307193 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4607fd10-c688-47f0-a7a6-9825d84a4293 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:55.455182 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-4607fd10-c688-47f0-a7a6-9825d84a4293 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e759dcbb0a4b57b13449ed7b195b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b12537f14f4f56b0b2b5b65ca459a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:11:55.462767 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-4607fd10-c688-47f0-a7a6-9825d84a4293 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] 10.222.0.16 "GET /compute/v2.1/servers/49257fa9-91e5-4513-8da9-e3114f577453" status: 200 len: 1470 microversion: 2.1 time: 0.170331 Jun 30 10:11:55.463334 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 534/1053] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:11:55 2022] GET /compute/v2.1/servers/49257fa9-91e5-4513-8da9-e3114f577453 => generated 1470 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:11:55.690182 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-2f462b98-de46-4b77-82c7-f0853c624834 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:11:55.690757 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-2f462b98-de46-4b77-82c7-f0853c624834 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:11:55.701006 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2f462b98-de46-4b77-82c7-f0853c624834 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:55.701458 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2f462b98-de46-4b77-82c7-f0853c624834 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:55.702606 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2f462b98-de46-4b77-82c7-f0853c624834 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:55.703204 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-2f462b98-de46-4b77-82c7-f0853c624834 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:55.847061 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-2f462b98-de46-4b77-82c7-f0853c624834 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc71c372e584ddf91290eefb53a973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c9f15ea7b84f54a6cfa004bd02de6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:11:55.854741 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-2f462b98-de46-4b77-82c7-f0853c624834 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f" status: 200 len: 1569 microversion: 2.1 time: 0.171377 Jun 30 10:11:55.855338 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 520/1054] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:11:55 2022] GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:11:56.481672 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f0de1bc8-f3bb-49c0-bb10-3f9d35e01f92 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:11:56.482286 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f0de1bc8-f3bb-49c0-bb10-3f9d35e01f92 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] [instance: 49257fa9-91e5-4513-8da9-e3114f577453] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:11:56.489456 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f0de1bc8-f3bb-49c0-bb10-3f9d35e01f92 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:56.489892 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f0de1bc8-f3bb-49c0-bb10-3f9d35e01f92 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:56.490650 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f0de1bc8-f3bb-49c0-bb10-3f9d35e01f92 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:56.491050 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f0de1bc8-f3bb-49c0-bb10-3f9d35e01f92 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:56.651412 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f0de1bc8-f3bb-49c0-bb10-3f9d35e01f92 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e759dcbb0a4b57b13449ed7b195b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b12537f14f4f56b0b2b5b65ca459a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:11:56.659342 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f0de1bc8-f3bb-49c0-bb10-3f9d35e01f92 tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] 10.222.0.16 "GET /compute/v2.1/servers/49257fa9-91e5-4513-8da9-e3114f577453" status: 200 len: 1470 microversion: 2.1 time: 0.181629 Jun 30 10:11:56.660308 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 535/1055] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:11:56 2022] GET /compute/v2.1/servers/49257fa9-91e5-4513-8da9-e3114f577453 => generated 1470 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:11:56.872434 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-23b058ea-ac12-4856-8623-066fe06a2336 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:11:56.873013 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-23b058ea-ac12-4856-8623-066fe06a2336 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:11:56.880650 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-23b058ea-ac12-4856-8623-066fe06a2336 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:56.881102 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-23b058ea-ac12-4856-8623-066fe06a2336 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:56.881870 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-23b058ea-ac12-4856-8623-066fe06a2336 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:56.882301 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-23b058ea-ac12-4856-8623-066fe06a2336 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:57.068685 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-23b058ea-ac12-4856-8623-066fe06a2336 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc71c372e584ddf91290eefb53a973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c9f15ea7b84f54a6cfa004bd02de6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:11:57.078120 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-23b058ea-ac12-4856-8623-066fe06a2336 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f" status: 200 len: 1569 microversion: 2.1 time: 0.209517 Jun 30 10:11:57.079269 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 521/1056] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:11:56 2022] GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f => generated 1569 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:11:57.185380 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-2fc9847c-5106-474f-94de-7f6fa4a807f0 req-c51cb424-866f-4892-8b48-c8be27dc2b74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49257fa9-91e5-4513-8da9-e3114f577453", "name": "network-vif-deleted", "tag": "3899e648-fd7d-44be-a916-4a31ca98b140"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:11:57.197367 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-2fc9847c-5106-474f-94de-7f6fa4a807f0 req-c51cb424-866f-4892-8b48-c8be27dc2b74 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:57.197904 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-2fc9847c-5106-474f-94de-7f6fa4a807f0 req-c51cb424-866f-4892-8b48-c8be27dc2b74 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:57.213484 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-2fc9847c-5106-474f-94de-7f6fa4a807f0 req-c51cb424-866f-4892-8b48-c8be27dc2b74 service nova] Creating event network-vif-deleted:3899e648-fd7d-44be-a916-4a31ca98b140 for instance 49257fa9-91e5-4513-8da9-e3114f577453 on hv-cinder-84330 Jun 30 10:11:57.218757 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-2fc9847c-5106-474f-94de-7f6fa4a807f0 req-c51cb424-866f-4892-8b48-c8be27dc2b74 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037251 Jun 30 10:11:57.220163 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 536/1057] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:11:57.677790 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-85ac33c5-0e7c-46d7-9fc0-2d10bcba2b1f tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:11:57.678508 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-85ac33c5-0e7c-46d7-9fc0-2d10bcba2b1f tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] [instance: 49257fa9-91e5-4513-8da9-e3114f577453] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:11:57.685766 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-85ac33c5-0e7c-46d7-9fc0-2d10bcba2b1f tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:57.686210 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-85ac33c5-0e7c-46d7-9fc0-2d10bcba2b1f tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:57.686987 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-85ac33c5-0e7c-46d7-9fc0-2d10bcba2b1f tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:57.687417 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-85ac33c5-0e7c-46d7-9fc0-2d10bcba2b1f tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:57.703103 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.wsgi [None req-85ac33c5-0e7c-46d7-9fc0-2d10bcba2b1f tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] HTTP exception thrown: Instance 49257fa9-91e5-4513-8da9-e3114f577453 could not be found. Jun 30 10:11:57.704781 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-85ac33c5-0e7c-46d7-9fc0-2d10bcba2b1f tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Request method failure captured: Jun 30 10:11:57.704781 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: request: GET /compute/v2.1/servers/49257fa9-91e5-4513-8da9-e3114f577453 HTTP/1.1 Jun 30 10:11:57.704781 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept: application/json Jun 30 10:11:57.704781 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept-Encoding: identity Jun 30 10:11:57.704781 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Connection: close Jun 30 10:11:57.704781 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Length: 0 Jun 30 10:11:57.704781 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Type: application/json Jun 30 10:11:57.704781 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Host: 10.222.0.16 Jun 30 10:11:57.704781 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Openstack-System-Scope: None Jun 30 10:11:57.704781 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: User-Agent: python-urllib3/1.26.9 Jun 30 10:11:57.704781 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Auth-Token: gAAAAABivXbeui7K_FM06FNkmxYRNfGXHr03PmLkYEJAs39KKVrgu6rdAqlURmI_OJGOF4kUi4IecgPITPMCr7mvq9PmRrYf3qJg7AL5INN0k3BHDxGyopp25gEBUi-WRFUDTeWYmsMlJedvBJ8BeMxYKOHwX-k15mApqSgTBBpCYQJbFQhTIrM Jun 30 10:11:57.704781 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Id: None Jun 30 10:11:57.704781 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Name: None Jun 30 10:11:57.704781 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Identity-Status: Confirmed Jun 30 10:11:57.704781 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Is-Admin-Project: True Jun 30 10:11:57.704781 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Id: default Jun 30 10:11:57.704781 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Name: Default Jun 30 10:11:57.704781 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Id: 12b12537f14f4f56b0b2b5b65ca459a7 Jun 30 10:11:57.704781 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Name: tempest-VolumesNegativeTest-457568544 Jun 30 10:11:57.704781 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Role: reader,member Jun 30 10:11:57.704781 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Roles: reader,member Jun 30 10:11:57.706877 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/12b12537f14f4f56b0b2b5b65ca459a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/12b12537f14f4f56b0b2b5b65ca459a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/12b12537f14f4f56b0b2b5b65ca459a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_12b12537f14f4f56b0b2b5b65ca459a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:11:57.706877 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant: tempest-VolumesNegativeTest-457568544 Jun 30 10:11:57.706877 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Id: 12b12537f14f4f56b0b2b5b65ca459a7 Jun 30 10:11:57.706877 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Name: tempest-VolumesNegativeTest-457568544 Jun 30 10:11:57.706877 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User: tempest-VolumesNegativeTest-457568544-project Jun 30 10:11:57.706877 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Id: default Jun 30 10:11:57.706877 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Name: Default Jun 30 10:11:57.706877 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Id: 44e759dcbb0a4b57b13449ed7b195b2e Jun 30 10:11:57.706877 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Name: tempest-VolumesNegativeTest-457568544-project Jun 30 10:11:57.706877 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: method: > Jun 30 10:11:57.706877 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: exception: Instance 49257fa9-91e5-4513-8da9-e3114f577453 could not be found. Jun 30 10:11:57.706877 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: action_args: {'id': '49257fa9-91e5-4513-8da9-e3114f577453'} Jun 30 10:11:57.708035 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:11:57.708035 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:11:57.708035 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:11:57.708035 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:11:57.708035 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:11:57.708035 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:11:57.708035 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:11:57.708035 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:11:57.708035 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:11:57.708035 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:11:57.708035 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49257fa9-91e5-4513-8da9-e3114f577453 could not be found. Jun 30 10:11:57.708035 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:11:57.708035 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:11:57.708035 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:11:57.708035 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:11:57.708035 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:11:57.708035 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:11:57.708035 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:11:57.708035 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:11:57.708035 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:11:57.709619 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:11:57.709619 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:11:57.709619 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:11:57.709619 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:11:57.709619 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:11:57.709619 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:11:57.709619 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:11:57.709619 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49257fa9-91e5-4513-8da9-e3114f577453 could not be found. Jun 30 10:11:57.709619 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:11:57.709619 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:11:57.709619 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:11:57.709619 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:11:57.709619 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:11:57.709619 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:11:57.709619 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:11:57.709619 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:11:57.709619 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49257fa9-91e5-4513-8da9-e3114f577453 could not be found. Jun 30 10:11:57.709619 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:11:57.710928 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-85ac33c5-0e7c-46d7-9fc0-2d10bcba2b1f tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] Returning 404 to user: Instance 49257fa9-91e5-4513-8da9-e3114f577453 could not be found. {{(pid=117847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:11:57.710928 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-85ac33c5-0e7c-46d7-9fc0-2d10bcba2b1f tempest-VolumesNegativeTest-457568544 tempest-VolumesNegativeTest-457568544-project] 10.222.0.16 "GET /compute/v2.1/servers/49257fa9-91e5-4513-8da9-e3114f577453" status: 404 len: 111 microversion: 2.1 time: 0.033426 Jun 30 10:11:57.710928 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 522/1058] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:11:57 2022] GET /compute/v2.1/servers/49257fa9-91e5-4513-8da9-e3114f577453 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 30 10:11:58.097069 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-261ef630-84ec-4c87-b92a-4d7b8ab2814e tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:11:58.097869 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-261ef630-84ec-4c87-b92a-4d7b8ab2814e tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:11:58.105031 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-261ef630-84ec-4c87-b92a-4d7b8ab2814e tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:58.105478 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-261ef630-84ec-4c87-b92a-4d7b8ab2814e tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:58.106363 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-261ef630-84ec-4c87-b92a-4d7b8ab2814e tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:58.106665 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-261ef630-84ec-4c87-b92a-4d7b8ab2814e tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:58.241899 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-261ef630-84ec-4c87-b92a-4d7b8ab2814e tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc71c372e584ddf91290eefb53a973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c9f15ea7b84f54a6cfa004bd02de6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:11:58.249469 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-261ef630-84ec-4c87-b92a-4d7b8ab2814e tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f" status: 200 len: 1569 microversion: 2.1 time: 0.156714 Jun 30 10:11:58.250072 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 537/1059] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:11:58 2022] GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:11:59.266538 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-fe1a2868-8a05-434e-913a-b2493cc7e94e tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:11:59.267151 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-fe1a2868-8a05-434e-913a-b2493cc7e94e tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:11:59.275703 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-fe1a2868-8a05-434e-913a-b2493cc7e94e tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:59.275703 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-fe1a2868-8a05-434e-913a-b2493cc7e94e tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:59.275703 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-fe1a2868-8a05-434e-913a-b2493cc7e94e tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:11:59.276060 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-fe1a2868-8a05-434e-913a-b2493cc7e94e tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:11:59.413269 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-fe1a2868-8a05-434e-913a-b2493cc7e94e tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc71c372e584ddf91290eefb53a973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c9f15ea7b84f54a6cfa004bd02de6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:11:59.421648 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-fe1a2868-8a05-434e-913a-b2493cc7e94e tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f" status: 200 len: 1569 microversion: 2.1 time: 0.159075 Jun 30 10:11:59.422223 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 523/1060] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:11:59 2022] GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:12:00.438500 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-78403200-880f-4ee0-8940-f8e2076d882d tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:12:00.439122 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-78403200-880f-4ee0-8940-f8e2076d882d tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:12:00.446485 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-78403200-880f-4ee0-8940-f8e2076d882d tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:00.446952 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-78403200-880f-4ee0-8940-f8e2076d882d tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:00.447704 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-78403200-880f-4ee0-8940-f8e2076d882d tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:00.448184 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-78403200-880f-4ee0-8940-f8e2076d882d tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:00.587141 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-78403200-880f-4ee0-8940-f8e2076d882d tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc71c372e584ddf91290eefb53a973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c9f15ea7b84f54a6cfa004bd02de6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:12:00.594868 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-78403200-880f-4ee0-8940-f8e2076d882d tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f" status: 200 len: 1569 microversion: 2.1 time: 0.160233 Jun 30 10:12:00.595431 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 538/1061] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:12:00 2022] GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:12:01.613301 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-e53177f4-add3-49bc-bc55-2c6341fa1c66 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:12:01.614210 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-e53177f4-add3-49bc-bc55-2c6341fa1c66 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:12:01.621190 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e53177f4-add3-49bc-bc55-2c6341fa1c66 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:01.621659 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e53177f4-add3-49bc-bc55-2c6341fa1c66 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:01.622982 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e53177f4-add3-49bc-bc55-2c6341fa1c66 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:01.623415 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-e53177f4-add3-49bc-bc55-2c6341fa1c66 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:01.776843 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-e53177f4-add3-49bc-bc55-2c6341fa1c66 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc71c372e584ddf91290eefb53a973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c9f15ea7b84f54a6cfa004bd02de6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:12:01.780432 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:01.785205 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-e53177f4-add3-49bc-bc55-2c6341fa1c66 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f" status: 200 len: 1569 microversion: 2.1 time: 0.177373 Jun 30 10:12:01.785759 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 524/1062] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:12:01 2022] GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:12:02.807511 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-72563b7f-eb07-454a-a5b9-46383f51c6c1 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:12:02.808550 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-72563b7f-eb07-454a-a5b9-46383f51c6c1 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:12:02.819618 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-72563b7f-eb07-454a-a5b9-46383f51c6c1 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:02.820112 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-72563b7f-eb07-454a-a5b9-46383f51c6c1 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:02.820870 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-72563b7f-eb07-454a-a5b9-46383f51c6c1 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:02.821309 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-72563b7f-eb07-454a-a5b9-46383f51c6c1 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:02.957645 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-72563b7f-eb07-454a-a5b9-46383f51c6c1 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc71c372e584ddf91290eefb53a973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c9f15ea7b84f54a6cfa004bd02de6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:12:02.965505 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-72563b7f-eb07-454a-a5b9-46383f51c6c1 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f" status: 200 len: 1569 microversion: 2.1 time: 0.165212 Jun 30 10:12:02.966071 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 539/1063] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:12:02 2022] GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:12:03.984815 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-a5eae39f-2220-410d-8ed8-151e68c2b444 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:12:03.985440 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-a5eae39f-2220-410d-8ed8-151e68c2b444 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:12:03.994274 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a5eae39f-2220-410d-8ed8-151e68c2b444 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:03.994758 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a5eae39f-2220-410d-8ed8-151e68c2b444 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:03.995640 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a5eae39f-2220-410d-8ed8-151e68c2b444 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:03.996269 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-a5eae39f-2220-410d-8ed8-151e68c2b444 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:04.140414 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-a5eae39f-2220-410d-8ed8-151e68c2b444 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc71c372e584ddf91290eefb53a973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c9f15ea7b84f54a6cfa004bd02de6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:12:04.152022 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-a5eae39f-2220-410d-8ed8-151e68c2b444 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f" status: 200 len: 1510 microversion: 2.1 time: 0.171426 Jun 30 10:12:04.152777 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 525/1064] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:12:03 2022] GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f => generated 1510 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:12:04.168746 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-30625655-851a-4ff6-bd1c-a10493c15b6e tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:12:04.169304 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-30625655-851a-4ff6-bd1c-a10493c15b6e tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:12:04.176243 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-30625655-851a-4ff6-bd1c-a10493c15b6e tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:04.176663 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-30625655-851a-4ff6-bd1c-a10493c15b6e tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:04.177771 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-30625655-851a-4ff6-bd1c-a10493c15b6e tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:04.178198 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-30625655-851a-4ff6-bd1c-a10493c15b6e tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:04.263138 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-30625655-851a-4ff6-bd1c-a10493c15b6e tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "POST /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f/action" status: 202 len: 0 microversion: 2.1 time: 0.098482 Jun 30 10:12:04.266685 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 540/1065] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Jun 30 10:12:04 2022] POST /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:12:04.272655 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-ae98db85-e60a-4794-9d96-241627b81ff6 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:12:04.274112 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-ae98db85-e60a-4794-9d96-241627b81ff6 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:12:04.283956 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ae98db85-e60a-4794-9d96-241627b81ff6 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:04.284809 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ae98db85-e60a-4794-9d96-241627b81ff6 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:04.286157 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ae98db85-e60a-4794-9d96-241627b81ff6 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:04.286688 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ae98db85-e60a-4794-9d96-241627b81ff6 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:04.460697 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-ae98db85-e60a-4794-9d96-241627b81ff6 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc71c372e584ddf91290eefb53a973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c9f15ea7b84f54a6cfa004bd02de6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:12:04.468984 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-ae98db85-e60a-4794-9d96-241627b81ff6 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f" status: 200 len: 1518 microversion: 2.1 time: 0.200832 Jun 30 10:12:04.469558 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 526/1066] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:12:04 2022] GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f => generated 1518 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:12:05.487588 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-5d760b8b-fcff-47f0-a172-9e14416770bc tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:12:05.488355 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-5d760b8b-fcff-47f0-a172-9e14416770bc tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:12:05.495076 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5d760b8b-fcff-47f0-a172-9e14416770bc tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:05.495636 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5d760b8b-fcff-47f0-a172-9e14416770bc tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:05.496411 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5d760b8b-fcff-47f0-a172-9e14416770bc tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:05.496831 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5d760b8b-fcff-47f0-a172-9e14416770bc tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:05.653679 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-5d760b8b-fcff-47f0-a172-9e14416770bc tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc71c372e584ddf91290eefb53a973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c9f15ea7b84f54a6cfa004bd02de6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:12:05.661989 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-5d760b8b-fcff-47f0-a172-9e14416770bc tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f" status: 200 len: 1520 microversion: 2.1 time: 0.179508 Jun 30 10:12:05.662511 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 541/1067] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:12:05 2022] GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:12:06.667137 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [req-0ef0b1b4-c4f5-4d6f-9584-bf3a3802059e req-8a830a8f-eb0d-400d-8a0e-d9267037e9d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0947fb10-14c6-4e0e-ad30-45bb44422c9f", "name": "network-vif-unplugged", "status": "completed", "tag": "e7fe2382-c98a-487a-ad01-556028fac2e1"}]} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:12:06.676569 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-0ef0b1b4-c4f5-4d6f-9584-bf3a3802059e req-8a830a8f-eb0d-400d-8a0e-d9267037e9d2 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:06.677549 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-0ef0b1b4-c4f5-4d6f-9584-bf3a3802059e req-8a830a8f-eb0d-400d-8a0e-d9267037e9d2 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:06.685107 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-620190da-68ac-4c26-88f5-4347c31db857 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:12:06.686017 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-620190da-68ac-4c26-88f5-4347c31db857 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:12:06.689935 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.compute.server_external_events [req-0ef0b1b4-c4f5-4d6f-9584-bf3a3802059e req-8a830a8f-eb0d-400d-8a0e-d9267037e9d2 service nova] Creating event network-vif-unplugged:e7fe2382-c98a-487a-ad01-556028fac2e1 for instance 0947fb10-14c6-4e0e-ad30-45bb44422c9f on hv-cinder-84330 Jun 30 10:12:06.692914 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-620190da-68ac-4c26-88f5-4347c31db857 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:06.693572 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-620190da-68ac-4c26-88f5-4347c31db857 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:06.694489 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-620190da-68ac-4c26-88f5-4347c31db857 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:06.695063 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [req-0ef0b1b4-c4f5-4d6f-9584-bf3a3802059e req-8a830a8f-eb0d-400d-8a0e-d9267037e9d2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031850 Jun 30 10:12:06.695242 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-620190da-68ac-4c26-88f5-4347c31db857 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:06.696002 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 527/1068] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:12:06.832782 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-620190da-68ac-4c26-88f5-4347c31db857 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc71c372e584ddf91290eefb53a973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c9f15ea7b84f54a6cfa004bd02de6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:12:06.837691 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:06.844066 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-620190da-68ac-4c26-88f5-4347c31db857 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f" status: 200 len: 1576 microversion: 2.1 time: 0.162909 Jun 30 10:12:06.844642 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 542/1069] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:12:06 2022] GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:12:07.868184 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-9a963cb3-3c21-423c-ad15-99b172f4cca1 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:12:07.869070 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-9a963cb3-3c21-423c-ad15-99b172f4cca1 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:12:07.877906 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9a963cb3-3c21-423c-ad15-99b172f4cca1 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:07.878349 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9a963cb3-3c21-423c-ad15-99b172f4cca1 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:07.879166 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9a963cb3-3c21-423c-ad15-99b172f4cca1 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:07.879784 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-9a963cb3-3c21-423c-ad15-99b172f4cca1 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:08.021937 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-9a963cb3-3c21-423c-ad15-99b172f4cca1 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc71c372e584ddf91290eefb53a973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c9f15ea7b84f54a6cfa004bd02de6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:12:08.032428 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-9a963cb3-3c21-423c-ad15-99b172f4cca1 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f" status: 200 len: 1576 microversion: 2.1 time: 0.171649 Jun 30 10:12:08.033191 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 528/1070] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:12:07 2022] GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:12:09.057631 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-321438b4-2cf8-4ac1-b631-05fa084a2141 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:12:09.058653 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-321438b4-2cf8-4ac1-b631-05fa084a2141 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:12:09.067811 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-321438b4-2cf8-4ac1-b631-05fa084a2141 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:09.068360 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-321438b4-2cf8-4ac1-b631-05fa084a2141 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:09.069223 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-321438b4-2cf8-4ac1-b631-05fa084a2141 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:09.069649 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-321438b4-2cf8-4ac1-b631-05fa084a2141 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:09.225812 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-321438b4-2cf8-4ac1-b631-05fa084a2141 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc71c372e584ddf91290eefb53a973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c9f15ea7b84f54a6cfa004bd02de6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:12:09.233834 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-321438b4-2cf8-4ac1-b631-05fa084a2141 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f" status: 200 len: 1576 microversion: 2.1 time: 0.181719 Jun 30 10:12:09.234376 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 543/1071] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:12:09 2022] GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f => generated 1576 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:12:10.254688 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-7e915404-8943-4c73-afe5-43766fbd7533 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:12:10.255268 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-7e915404-8943-4c73-afe5-43766fbd7533 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:12:10.265456 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7e915404-8943-4c73-afe5-43766fbd7533 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:10.266059 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7e915404-8943-4c73-afe5-43766fbd7533 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:10.267119 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7e915404-8943-4c73-afe5-43766fbd7533 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:10.267753 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-7e915404-8943-4c73-afe5-43766fbd7533 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:10.407549 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-7e915404-8943-4c73-afe5-43766fbd7533 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc71c372e584ddf91290eefb53a973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c9f15ea7b84f54a6cfa004bd02de6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:12:10.415768 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-7e915404-8943-4c73-afe5-43766fbd7533 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f" status: 200 len: 1576 microversion: 2.1 time: 0.167675 Jun 30 10:12:10.416199 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 529/1072] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:12:10 2022] GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:12:11.435404 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-d438c262-9839-490b-a6b8-2aa101273101 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:12:11.436221 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-d438c262-9839-490b-a6b8-2aa101273101 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:12:11.444572 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d438c262-9839-490b-a6b8-2aa101273101 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:11.445025 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d438c262-9839-490b-a6b8-2aa101273101 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:11.445802 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d438c262-9839-490b-a6b8-2aa101273101 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:11.446229 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d438c262-9839-490b-a6b8-2aa101273101 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:11.600027 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-d438c262-9839-490b-a6b8-2aa101273101 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc71c372e584ddf91290eefb53a973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c9f15ea7b84f54a6cfa004bd02de6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:12:11.611157 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-d438c262-9839-490b-a6b8-2aa101273101 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f" status: 200 len: 1576 microversion: 2.1 time: 0.180846 Jun 30 10:12:11.611928 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 544/1073] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:12:11 2022] GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f => generated 1576 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:12:12.629374 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-443e8b69-2ab7-43bc-bf02-1580fc481f55 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:12:12.630116 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-443e8b69-2ab7-43bc-bf02-1580fc481f55 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:12:12.641201 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-443e8b69-2ab7-43bc-bf02-1580fc481f55 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:12.642012 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-443e8b69-2ab7-43bc-bf02-1580fc481f55 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:12.643338 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-443e8b69-2ab7-43bc-bf02-1580fc481f55 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:12.643837 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-443e8b69-2ab7-43bc-bf02-1580fc481f55 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:12.791789 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-443e8b69-2ab7-43bc-bf02-1580fc481f55 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc71c372e584ddf91290eefb53a973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c9f15ea7b84f54a6cfa004bd02de6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:12:12.804810 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-443e8b69-2ab7-43bc-bf02-1580fc481f55 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f" status: 200 len: 1576 microversion: 2.1 time: 0.179342 Jun 30 10:12:12.805378 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 530/1074] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:12:12 2022] GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f => generated 1576 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:12:13.829692 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-54f21613-dee4-4ee6-beef-bb47fb35167f tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:12:13.830670 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-54f21613-dee4-4ee6-beef-bb47fb35167f tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:12:13.838766 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-54f21613-dee4-4ee6-beef-bb47fb35167f tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:13.839208 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-54f21613-dee4-4ee6-beef-bb47fb35167f tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:13.840008 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-54f21613-dee4-4ee6-beef-bb47fb35167f tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:13.840442 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-54f21613-dee4-4ee6-beef-bb47fb35167f tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:13.987890 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-54f21613-dee4-4ee6-beef-bb47fb35167f tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc71c372e584ddf91290eefb53a973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c9f15ea7b84f54a6cfa004bd02de6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:12:13.996461 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-54f21613-dee4-4ee6-beef-bb47fb35167f tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f" status: 200 len: 1576 microversion: 2.1 time: 0.172951 Jun 30 10:12:13.997120 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 545/1075] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:12:13 2022] GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:12:15.018950 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-6dfbae5c-9af4-445b-8eb2-e6b8cf0f5728 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:12:15.019576 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-6dfbae5c-9af4-445b-8eb2-e6b8cf0f5728 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:12:15.022194 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:15.027822 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-6dfbae5c-9af4-445b-8eb2-e6b8cf0f5728 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:15.028296 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-6dfbae5c-9af4-445b-8eb2-e6b8cf0f5728 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:15.029056 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-6dfbae5c-9af4-445b-8eb2-e6b8cf0f5728 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:15.029485 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-6dfbae5c-9af4-445b-8eb2-e6b8cf0f5728 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:15.178458 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-6dfbae5c-9af4-445b-8eb2-e6b8cf0f5728 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc71c372e584ddf91290eefb53a973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c9f15ea7b84f54a6cfa004bd02de6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:12:15.191066 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-6dfbae5c-9af4-445b-8eb2-e6b8cf0f5728 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f" status: 200 len: 1563 microversion: 2.1 time: 0.175987 Jun 30 10:12:15.191772 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 531/1076] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:12:15 2022] GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f => generated 1563 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:12:16.798168 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-bcc5bc5b-7ebb-4e12-9208-ced8e4eedb7c req-65f395b4-89f4-4309-9173-74ac6499e0bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0947fb10-14c6-4e0e-ad30-45bb44422c9f", "name": "network-vif-plugged", "status": "completed", "tag": "e7fe2382-c98a-487a-ad01-556028fac2e1"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:12:16.802686 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=47 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:16.808802 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-bcc5bc5b-7ebb-4e12-9208-ced8e4eedb7c req-65f395b4-89f4-4309-9173-74ac6499e0bd service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:16.809247 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-bcc5bc5b-7ebb-4e12-9208-ced8e4eedb7c req-65f395b4-89f4-4309-9173-74ac6499e0bd service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:16.822013 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-bcc5bc5b-7ebb-4e12-9208-ced8e4eedb7c req-65f395b4-89f4-4309-9173-74ac6499e0bd service nova] Creating event network-vif-plugged:e7fe2382-c98a-487a-ad01-556028fac2e1 for instance 0947fb10-14c6-4e0e-ad30-45bb44422c9f on hv-cinder-84330 Jun 30 10:12:16.827213 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-bcc5bc5b-7ebb-4e12-9208-ced8e4eedb7c req-65f395b4-89f4-4309-9173-74ac6499e0bd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032811 Jun 30 10:12:16.827911 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 546/1077] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:12:23.558647 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 10:12:23.559223 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Thu Jun 30 10:12:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 10:12:32.273413 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=20 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:32.274881 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-6bffe9b6-600d-4d2f-93dc-c0b29f82a027 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:12:32.275421 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-6bffe9b6-600d-4d2f-93dc-c0b29f82a027 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 2283b227-4655-4c28-9ceb-e725ac71fcb9] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:12:32.275974 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:32.280625 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_api:SELECT=1 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:32.281414 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell1:SELECT=38 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:32.283509 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-f4957432-8d06-4bc5-9ce1-4711f7cedf30 req-f72108ce-9ef7-475a-9f4f-6ef4ec6ed2f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2283b227-4655-4c28-9ceb-e725ac71fcb9", "tag": "31d78f4e-5b71-4dd8-81c6-5f0651a00247"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:12:32.291842 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-6bffe9b6-600d-4d2f-93dc-c0b29f82a027 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:32.291842 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-6bffe9b6-600d-4d2f-93dc-c0b29f82a027 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:32.291842 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-6bffe9b6-600d-4d2f-93dc-c0b29f82a027 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:32.291842 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-6bffe9b6-600d-4d2f-93dc-c0b29f82a027 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:32.292718 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-f4957432-8d06-4bc5-9ce1-4711f7cedf30 req-f72108ce-9ef7-475a-9f4f-6ef4ec6ed2f2 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:32.293368 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-f4957432-8d06-4bc5-9ce1-4711f7cedf30 req-f72108ce-9ef7-475a-9f4f-6ef4ec6ed2f2 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:32.308513 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-f4957432-8d06-4bc5-9ce1-4711f7cedf30 req-f72108ce-9ef7-475a-9f4f-6ef4ec6ed2f2 service nova] Creating event network-changed:31d78f4e-5b71-4dd8-81c6-5f0651a00247 for instance 2283b227-4655-4c28-9ceb-e725ac71fcb9 on hv-cinder-84330 Jun 30 10:12:32.314558 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-f4957432-8d06-4bc5-9ce1-4711f7cedf30 req-f72108ce-9ef7-475a-9f4f-6ef4ec6ed2f2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043167 Jun 30 10:12:32.315812 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 547/1078] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:12:32.327536 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-6bffe9b6-600d-4d2f-93dc-c0b29f82a027 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 2283b227-4655-4c28-9ceb-e725ac71fcb9] Going to try to terminate instance {{(pid=117847) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 10:12:32.417167 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-6bffe9b6-600d-4d2f-93dc-c0b29f82a027 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2283b227-4655-4c28-9ceb-e725ac71fcb9" status: 204 len: 0 microversion: 2.1 time: 0.148242 Jun 30 10:12:32.418406 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 532/1079] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 10:12:32 2022] DELETE /compute/v2.1/servers/2283b227-4655-4c28-9ceb-e725ac71fcb9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 10:12:32.427725 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-cb711a19-294e-452f-a230-7e98801078cb tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:12:32.428686 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-cb711a19-294e-452f-a230-7e98801078cb tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 2283b227-4655-4c28-9ceb-e725ac71fcb9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:12:32.435993 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cb711a19-294e-452f-a230-7e98801078cb tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:32.436444 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cb711a19-294e-452f-a230-7e98801078cb tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:32.437309 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cb711a19-294e-452f-a230-7e98801078cb tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:32.437757 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cb711a19-294e-452f-a230-7e98801078cb tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:32.616346 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-cb711a19-294e-452f-a230-7e98801078cb tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:12:32.624729 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-cb711a19-294e-452f-a230-7e98801078cb tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/2283b227-4655-4c28-9ceb-e725ac71fcb9" status: 200 len: 1575 microversion: 2.1 time: 0.201882 Jun 30 10:12:32.625400 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 548/1080] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:12:32 2022] GET /compute/v2.1/servers/2283b227-4655-4c28-9ceb-e725ac71fcb9 => generated 1575 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 10:12:33.645970 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-32262451-e89b-4867-a18a-07d2ad6d2ce2 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:12:33.646942 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-32262451-e89b-4867-a18a-07d2ad6d2ce2 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 2283b227-4655-4c28-9ceb-e725ac71fcb9] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:12:33.656339 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-32262451-e89b-4867-a18a-07d2ad6d2ce2 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:33.656974 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-32262451-e89b-4867-a18a-07d2ad6d2ce2 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:33.658033 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-32262451-e89b-4867-a18a-07d2ad6d2ce2 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:33.658642 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-32262451-e89b-4867-a18a-07d2ad6d2ce2 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:33.867667 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-32262451-e89b-4867-a18a-07d2ad6d2ce2 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:12:33.875710 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-32262451-e89b-4867-a18a-07d2ad6d2ce2 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/2283b227-4655-4c28-9ceb-e725ac71fcb9" status: 200 len: 1575 microversion: 2.1 time: 0.235863 Jun 30 10:12:33.876328 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 533/1081] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:12:33 2022] GET /compute/v2.1/servers/2283b227-4655-4c28-9ceb-e725ac71fcb9 => generated 1575 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:12:34.709184 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-c6ce2625-0009-4cfa-96be-5bba0dade88f req-46579ab6-b0e1-43cf-ae08-553c1b068117 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2283b227-4655-4c28-9ceb-e725ac71fcb9", "name": "network-vif-deleted", "tag": "31d78f4e-5b71-4dd8-81c6-5f0651a00247"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:12:34.718044 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-c6ce2625-0009-4cfa-96be-5bba0dade88f req-46579ab6-b0e1-43cf-ae08-553c1b068117 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:34.718493 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-c6ce2625-0009-4cfa-96be-5bba0dade88f req-46579ab6-b0e1-43cf-ae08-553c1b068117 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:34.730973 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-c6ce2625-0009-4cfa-96be-5bba0dade88f req-46579ab6-b0e1-43cf-ae08-553c1b068117 service nova] Creating event network-vif-deleted:31d78f4e-5b71-4dd8-81c6-5f0651a00247 for instance 2283b227-4655-4c28-9ceb-e725ac71fcb9 on hv-cinder-84330 Jun 30 10:12:34.735757 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-c6ce2625-0009-4cfa-96be-5bba0dade88f req-46579ab6-b0e1-43cf-ae08-553c1b068117 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030381 Jun 30 10:12:34.736583 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 549/1082] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:12:34.896110 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-4a0701dd-c62b-48d9-9095-84464efdf39a tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:12:34.897479 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-4a0701dd-c62b-48d9-9095-84464efdf39a tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 2283b227-4655-4c28-9ceb-e725ac71fcb9] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:12:34.904700 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4a0701dd-c62b-48d9-9095-84464efdf39a tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:34.905142 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4a0701dd-c62b-48d9-9095-84464efdf39a tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:34.905901 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4a0701dd-c62b-48d9-9095-84464efdf39a tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:34.906309 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-4a0701dd-c62b-48d9-9095-84464efdf39a tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:34.969158 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-4a0701dd-c62b-48d9-9095-84464efdf39a tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:12:34.977739 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-4a0701dd-c62b-48d9-9095-84464efdf39a tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/2283b227-4655-4c28-9ceb-e725ac71fcb9" status: 200 len: 1224 microversion: 2.1 time: 0.087266 Jun 30 10:12:34.978679 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 534/1083] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:12:34 2022] GET /compute/v2.1/servers/2283b227-4655-4c28-9ceb-e725ac71fcb9 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:12:36.002286 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ac93a2a8-af43-4d1f-a1d1-ff32203c8b8f tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:12:36.003237 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-ac93a2a8-af43-4d1f-a1d1-ff32203c8b8f tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 2283b227-4655-4c28-9ceb-e725ac71fcb9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:12:36.010509 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ac93a2a8-af43-4d1f-a1d1-ff32203c8b8f tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:36.010950 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ac93a2a8-af43-4d1f-a1d1-ff32203c8b8f tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:36.011721 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ac93a2a8-af43-4d1f-a1d1-ff32203c8b8f tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:36.012156 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ac93a2a8-af43-4d1f-a1d1-ff32203c8b8f tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:36.025828 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-ac93a2a8-af43-4d1f-a1d1-ff32203c8b8f tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] HTTP exception thrown: Instance 2283b227-4655-4c28-9ceb-e725ac71fcb9 could not be found. Jun 30 10:12:36.027457 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ac93a2a8-af43-4d1f-a1d1-ff32203c8b8f tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Request method failure captured: Jun 30 10:12:36.027457 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: request: GET /compute/v2.1/servers/2283b227-4655-4c28-9ceb-e725ac71fcb9 HTTP/1.1 Jun 30 10:12:36.027457 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept: application/json Jun 30 10:12:36.027457 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jun 30 10:12:36.027457 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Connection: close Jun 30 10:12:36.027457 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jun 30 10:12:36.027457 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jun 30 10:12:36.027457 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Host: 10.222.0.16 Jun 30 10:12:36.027457 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jun 30 10:12:36.027457 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jun 30 10:12:36.027457 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABivXV52OD_4Rc9L3x6-t_Z1lNdOD-WFD2ojgW-2JKeZGoZHbpypR-rdoNl09Ij-K_fFClJQU2sEjXV1toYuhue3UW9VcXZ_9kNxqCkETc-0LJvGV1J0XlnsL8h5_RyD57luBBUztLHMf5Zix_mSPGFqYW_X5HpyPAE0L2QT7PaLxmaRIY Jun 30 10:12:36.027457 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jun 30 10:12:36.027457 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jun 30 10:12:36.027457 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jun 30 10:12:36.027457 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jun 30 10:12:36.027457 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jun 30 10:12:36.027457 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jun 30 10:12:36.027457 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Id: 108ee256fba04d1b83fe00c166742f0b Jun 30 10:12:36.027457 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-TestVolumeBootPattern-755875873 Jun 30 10:12:36.027457 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Role: reader,member Jun 30 10:12:36.027457 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Roles: reader,member Jun 30 10:12:36.029078 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/108ee256fba04d1b83fe00c166742f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/108ee256fba04d1b83fe00c166742f0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/108ee256fba04d1b83fe00c166742f0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_108ee256fba04d1b83fe00c166742f0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:12:36.029078 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-TestVolumeBootPattern-755875873 Jun 30 10:12:36.029078 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 108ee256fba04d1b83fe00c166742f0b Jun 30 10:12:36.029078 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-TestVolumeBootPattern-755875873 Jun 30 10:12:36.029078 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User: tempest-TestVolumeBootPattern-755875873-project Jun 30 10:12:36.029078 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jun 30 10:12:36.029078 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jun 30 10:12:36.029078 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Id: ead8ee09f8514e75882c877042764a92 Jun 30 10:12:36.029078 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-TestVolumeBootPattern-755875873-project Jun 30 10:12:36.029078 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: method: > Jun 30 10:12:36.029078 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: exception: Instance 2283b227-4655-4c28-9ceb-e725ac71fcb9 could not be found. Jun 30 10:12:36.029078 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: action_args: {'id': '2283b227-4655-4c28-9ceb-e725ac71fcb9'} Jun 30 10:12:36.029983 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:12:36.029983 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:12:36.029983 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:12:36.029983 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:12:36.029983 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:12:36.029983 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:12:36.029983 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:12:36.029983 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:12:36.029983 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:12:36.029983 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:12:36.029983 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2283b227-4655-4c28-9ceb-e725ac71fcb9 could not be found. Jun 30 10:12:36.029983 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:12:36.029983 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:12:36.029983 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:12:36.029983 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:12:36.029983 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:12:36.029983 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:12:36.029983 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:12:36.029983 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:12:36.029983 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:12:36.031507 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:12:36.031507 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:12:36.031507 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:12:36.031507 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:12:36.031507 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:12:36.031507 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:12:36.031507 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:12:36.031507 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2283b227-4655-4c28-9ceb-e725ac71fcb9 could not be found. Jun 30 10:12:36.031507 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:12:36.031507 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:12:36.031507 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:12:36.031507 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:12:36.031507 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:12:36.031507 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:12:36.031507 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:12:36.031507 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:12:36.031507 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2283b227-4655-4c28-9ceb-e725ac71fcb9 could not be found. Jun 30 10:12:36.031507 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:12:36.033099 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ac93a2a8-af43-4d1f-a1d1-ff32203c8b8f tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Returning 404 to user: Instance 2283b227-4655-4c28-9ceb-e725ac71fcb9 could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:12:36.033099 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ac93a2a8-af43-4d1f-a1d1-ff32203c8b8f tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/2283b227-4655-4c28-9ceb-e725ac71fcb9" status: 404 len: 111 microversion: 2.1 time: 0.034450 Jun 30 10:12:36.033099 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 550/1084] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:12:35 2022] GET /compute/v2.1/servers/2283b227-4655-4c28-9ceb-e725ac71fcb9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:12:39.421477 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-14cc62c8-0e8b-4907-a5cd-91dab553e114 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:12:39.421990 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-14cc62c8-0e8b-4907-a5cd-91dab553e114 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 45794da3-96ef-4de2-9c53-81638fbfe2f2] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:12:39.429935 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-14cc62c8-0e8b-4907-a5cd-91dab553e114 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:39.430442 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-14cc62c8-0e8b-4907-a5cd-91dab553e114 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:39.431268 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-14cc62c8-0e8b-4907-a5cd-91dab553e114 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:39.431830 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-14cc62c8-0e8b-4907-a5cd-91dab553e114 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:39.458008 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-14cc62c8-0e8b-4907-a5cd-91dab553e114 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 45794da3-96ef-4de2-9c53-81638fbfe2f2] Going to try to terminate instance {{(pid=117847) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 10:12:39.486080 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-e985e57d-4545-4364-bf4b-8662ef538e74 req-061ad0a3-6dcd-4d55-96ca-e34aa18ef719 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45794da3-96ef-4de2-9c53-81638fbfe2f2", "tag": "ce90e702-7fe9-494e-a81c-004285bde603"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:12:39.494825 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-e985e57d-4545-4364-bf4b-8662ef538e74 req-061ad0a3-6dcd-4d55-96ca-e34aa18ef719 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:39.495508 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-e985e57d-4545-4364-bf4b-8662ef538e74 req-061ad0a3-6dcd-4d55-96ca-e34aa18ef719 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:39.508240 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-e985e57d-4545-4364-bf4b-8662ef538e74 req-061ad0a3-6dcd-4d55-96ca-e34aa18ef719 service nova] Creating event network-changed:ce90e702-7fe9-494e-a81c-004285bde603 for instance 45794da3-96ef-4de2-9c53-81638fbfe2f2 on hv-cinder-84330 Jun 30 10:12:39.513656 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-e985e57d-4545-4364-bf4b-8662ef538e74 req-061ad0a3-6dcd-4d55-96ca-e34aa18ef719 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093795 Jun 30 10:12:39.514726 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 551/1085] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:12:39.548427 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-14cc62c8-0e8b-4907-a5cd-91dab553e114 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "DELETE /compute/v2.1/servers/45794da3-96ef-4de2-9c53-81638fbfe2f2" status: 204 len: 0 microversion: 2.1 time: 0.130312 Jun 30 10:12:39.553195 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 535/1086] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 10:12:39 2022] DELETE /compute/v2.1/servers/45794da3-96ef-4de2-9c53-81638fbfe2f2 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 10:12:39.559040 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-1f0a09a5-159f-47dd-b386-093da53a9244 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:12:39.559830 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-1f0a09a5-159f-47dd-b386-093da53a9244 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 45794da3-96ef-4de2-9c53-81638fbfe2f2] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:12:39.567039 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1f0a09a5-159f-47dd-b386-093da53a9244 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:39.567632 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1f0a09a5-159f-47dd-b386-093da53a9244 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:39.568471 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1f0a09a5-159f-47dd-b386-093da53a9244 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:39.569095 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1f0a09a5-159f-47dd-b386-093da53a9244 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:39.705771 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-1f0a09a5-159f-47dd-b386-093da53a9244 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:12:39.713746 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-1f0a09a5-159f-47dd-b386-093da53a9244 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/45794da3-96ef-4de2-9c53-81638fbfe2f2" status: 200 len: 1576 microversion: 2.1 time: 0.158981 Jun 30 10:12:39.714408 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 552/1087] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:12:39 2022] GET /compute/v2.1/servers/45794da3-96ef-4de2-9c53-81638fbfe2f2 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:12:40.736247 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-08a24cb8-cf26-4fa5-a4fe-402821747ae8 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:12:40.737374 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-08a24cb8-cf26-4fa5-a4fe-402821747ae8 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 45794da3-96ef-4de2-9c53-81638fbfe2f2] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:12:40.744891 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-08a24cb8-cf26-4fa5-a4fe-402821747ae8 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:40.745342 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-08a24cb8-cf26-4fa5-a4fe-402821747ae8 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:40.746086 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-08a24cb8-cf26-4fa5-a4fe-402821747ae8 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:40.746512 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-08a24cb8-cf26-4fa5-a4fe-402821747ae8 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:40.937018 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-08a24cb8-cf26-4fa5-a4fe-402821747ae8 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:12:40.944901 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-08a24cb8-cf26-4fa5-a4fe-402821747ae8 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/45794da3-96ef-4de2-9c53-81638fbfe2f2" status: 200 len: 1576 microversion: 2.1 time: 0.215668 Jun 30 10:12:40.945460 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 536/1088] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:12:40 2022] GET /compute/v2.1/servers/45794da3-96ef-4de2-9c53-81638fbfe2f2 => generated 1576 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:12:41.642315 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-25d189f7-6aa2-49c8-9838-2d837acc3180 req-88c8b652-8fc3-43af-a059-52a19f64260d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45794da3-96ef-4de2-9c53-81638fbfe2f2", "name": "network-vif-deleted", "tag": "ce90e702-7fe9-494e-a81c-004285bde603"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:12:41.652458 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-25d189f7-6aa2-49c8-9838-2d837acc3180 req-88c8b652-8fc3-43af-a059-52a19f64260d service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:41.652901 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-25d189f7-6aa2-49c8-9838-2d837acc3180 req-88c8b652-8fc3-43af-a059-52a19f64260d service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:41.665431 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-25d189f7-6aa2-49c8-9838-2d837acc3180 req-88c8b652-8fc3-43af-a059-52a19f64260d service nova] Creating event network-vif-deleted:ce90e702-7fe9-494e-a81c-004285bde603 for instance 45794da3-96ef-4de2-9c53-81638fbfe2f2 on hv-cinder-84330 Jun 30 10:12:41.670972 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-25d189f7-6aa2-49c8-9838-2d837acc3180 req-88c8b652-8fc3-43af-a059-52a19f64260d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032396 Jun 30 10:12:41.671640 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 553/1089] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:12:41.962554 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-316566be-09ce-407d-8c37-d3b9fdc7b8b1 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:12:41.963361 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-316566be-09ce-407d-8c37-d3b9fdc7b8b1 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 45794da3-96ef-4de2-9c53-81638fbfe2f2] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:12:41.970567 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-316566be-09ce-407d-8c37-d3b9fdc7b8b1 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:41.970764 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-316566be-09ce-407d-8c37-d3b9fdc7b8b1 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:41.971537 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-316566be-09ce-407d-8c37-d3b9fdc7b8b1 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:41.972023 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-316566be-09ce-407d-8c37-d3b9fdc7b8b1 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:42.006147 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-316566be-09ce-407d-8c37-d3b9fdc7b8b1 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:42.006589 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-316566be-09ce-407d-8c37-d3b9fdc7b8b1 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:42.007026 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.objects.instance [None req-316566be-09ce-407d-8c37-d3b9fdc7b8b1 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lazy-loading 'fault' on Instance uuid 45794da3-96ef-4de2-9c53-81638fbfe2f2 {{(pid=117847) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:12:42.050097 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-316566be-09ce-407d-8c37-d3b9fdc7b8b1 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead8ee09f8514e75882c877042764a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108ee256fba04d1b83fe00c166742f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:12:42.058576 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-316566be-09ce-407d-8c37-d3b9fdc7b8b1 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/45794da3-96ef-4de2-9c53-81638fbfe2f2" status: 200 len: 1229 microversion: 2.1 time: 0.100063 Jun 30 10:12:42.059142 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 537/1090] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:12:41 2022] GET /compute/v2.1/servers/45794da3-96ef-4de2-9c53-81638fbfe2f2 => generated 1229 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:12:43.078476 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-fc23a8cf-8225-4896-9f45-cbb62758519d tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:12:43.079148 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-fc23a8cf-8225-4896-9f45-cbb62758519d tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 45794da3-96ef-4de2-9c53-81638fbfe2f2] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:12:43.086120 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fc23a8cf-8225-4896-9f45-cbb62758519d tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:43.086564 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fc23a8cf-8225-4896-9f45-cbb62758519d tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:43.087331 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fc23a8cf-8225-4896-9f45-cbb62758519d tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:43.088111 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fc23a8cf-8225-4896-9f45-cbb62758519d tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:43.104950 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-fc23a8cf-8225-4896-9f45-cbb62758519d tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] HTTP exception thrown: Instance 45794da3-96ef-4de2-9c53-81638fbfe2f2 could not be found. Jun 30 10:12:43.106566 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-fc23a8cf-8225-4896-9f45-cbb62758519d tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Request method failure captured: Jun 30 10:12:43.106566 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: request: GET /compute/v2.1/servers/45794da3-96ef-4de2-9c53-81638fbfe2f2 HTTP/1.1 Jun 30 10:12:43.106566 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept: application/json Jun 30 10:12:43.106566 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jun 30 10:12:43.106566 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Connection: close Jun 30 10:12:43.106566 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jun 30 10:12:43.106566 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jun 30 10:12:43.106566 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Host: 10.222.0.16 Jun 30 10:12:43.106566 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jun 30 10:12:43.106566 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jun 30 10:12:43.106566 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABivXV52OD_4Rc9L3x6-t_Z1lNdOD-WFD2ojgW-2JKeZGoZHbpypR-rdoNl09Ij-K_fFClJQU2sEjXV1toYuhue3UW9VcXZ_9kNxqCkETc-0LJvGV1J0XlnsL8h5_RyD57luBBUztLHMf5Zix_mSPGFqYW_X5HpyPAE0L2QT7PaLxmaRIY Jun 30 10:12:43.106566 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jun 30 10:12:43.106566 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jun 30 10:12:43.106566 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jun 30 10:12:43.106566 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jun 30 10:12:43.106566 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jun 30 10:12:43.106566 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jun 30 10:12:43.106566 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Id: 108ee256fba04d1b83fe00c166742f0b Jun 30 10:12:43.106566 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-TestVolumeBootPattern-755875873 Jun 30 10:12:43.106566 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Role: reader,member Jun 30 10:12:43.106566 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Roles: reader,member Jun 30 10:12:43.108893 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/108ee256fba04d1b83fe00c166742f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/108ee256fba04d1b83fe00c166742f0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/108ee256fba04d1b83fe00c166742f0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_108ee256fba04d1b83fe00c166742f0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:12:43.108893 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-TestVolumeBootPattern-755875873 Jun 30 10:12:43.108893 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 108ee256fba04d1b83fe00c166742f0b Jun 30 10:12:43.108893 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-TestVolumeBootPattern-755875873 Jun 30 10:12:43.108893 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User: tempest-TestVolumeBootPattern-755875873-project Jun 30 10:12:43.108893 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jun 30 10:12:43.108893 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jun 30 10:12:43.108893 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Id: ead8ee09f8514e75882c877042764a92 Jun 30 10:12:43.108893 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-TestVolumeBootPattern-755875873-project Jun 30 10:12:43.108893 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: method: > Jun 30 10:12:43.108893 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: exception: Instance 45794da3-96ef-4de2-9c53-81638fbfe2f2 could not be found. Jun 30 10:12:43.108893 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: action_args: {'id': '45794da3-96ef-4de2-9c53-81638fbfe2f2'} Jun 30 10:12:43.110083 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:12:43.110083 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:12:43.110083 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:12:43.110083 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:12:43.110083 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:12:43.110083 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:12:43.110083 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:12:43.110083 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:12:43.110083 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:12:43.110083 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:12:43.110083 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45794da3-96ef-4de2-9c53-81638fbfe2f2 could not be found. Jun 30 10:12:43.110083 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:12:43.110083 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:12:43.110083 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:12:43.110083 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:12:43.110083 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:12:43.110083 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:12:43.110083 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:12:43.110083 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:12:43.110083 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:12:43.112252 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:12:43.112252 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:12:43.112252 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:12:43.112252 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:12:43.112252 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:12:43.112252 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:12:43.112252 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:12:43.112252 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45794da3-96ef-4de2-9c53-81638fbfe2f2 could not be found. Jun 30 10:12:43.112252 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:12:43.112252 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:12:43.112252 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:12:43.112252 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:12:43.112252 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:12:43.112252 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:12:43.112252 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:12:43.112252 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:12:43.112252 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45794da3-96ef-4de2-9c53-81638fbfe2f2 could not be found. Jun 30 10:12:43.112252 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:12:43.113724 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-fc23a8cf-8225-4896-9f45-cbb62758519d tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Returning 404 to user: Instance 45794da3-96ef-4de2-9c53-81638fbfe2f2 could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:12:43.113724 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-fc23a8cf-8225-4896-9f45-cbb62758519d tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/45794da3-96ef-4de2-9c53-81638fbfe2f2" status: 404 len: 111 microversion: 2.1 time: 0.035109 Jun 30 10:12:43.113724 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 554/1091] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:12:43 2022] GET /compute/v2.1/servers/45794da3-96ef-4de2-9c53-81638fbfe2f2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:12:43.646180 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-ff2d0229-e3b8-4e5f-9ada-51f304acdfa5 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:12:43.647991 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-ff2d0229-e3b8-4e5f-9ada-51f304acdfa5 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 1802a0eb-4ac0-4939-b119-af84e90c5859] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:12:43.653730 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ff2d0229-e3b8-4e5f-9ada-51f304acdfa5 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:43.654179 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ff2d0229-e3b8-4e5f-9ada-51f304acdfa5 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:43.654946 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ff2d0229-e3b8-4e5f-9ada-51f304acdfa5 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:43.655384 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-ff2d0229-e3b8-4e5f-9ada-51f304acdfa5 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:43.669893 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.wsgi [None req-ff2d0229-e3b8-4e5f-9ada-51f304acdfa5 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] HTTP exception thrown: Instance 1802a0eb-4ac0-4939-b119-af84e90c5859 could not be found. Jun 30 10:12:43.671612 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-ff2d0229-e3b8-4e5f-9ada-51f304acdfa5 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Request method failure captured: Jun 30 10:12:43.671612 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: request: DELETE /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859 HTTP/1.1 Jun 30 10:12:43.671612 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept: application/json Jun 30 10:12:43.671612 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept-Encoding: identity Jun 30 10:12:43.671612 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Connection: close Jun 30 10:12:43.671612 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Length: 0 Jun 30 10:12:43.671612 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Type: application/json Jun 30 10:12:43.671612 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Host: 10.222.0.16 Jun 30 10:12:43.671612 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Openstack-System-Scope: None Jun 30 10:12:43.671612 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: User-Agent: python-urllib3/1.26.9 Jun 30 10:12:43.671612 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Auth-Token: gAAAAABivXV52OD_4Rc9L3x6-t_Z1lNdOD-WFD2ojgW-2JKeZGoZHbpypR-rdoNl09Ij-K_fFClJQU2sEjXV1toYuhue3UW9VcXZ_9kNxqCkETc-0LJvGV1J0XlnsL8h5_RyD57luBBUztLHMf5Zix_mSPGFqYW_X5HpyPAE0L2QT7PaLxmaRIY Jun 30 10:12:43.671612 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Id: None Jun 30 10:12:43.671612 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Name: None Jun 30 10:12:43.671612 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Identity-Status: Confirmed Jun 30 10:12:43.671612 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Is-Admin-Project: True Jun 30 10:12:43.671612 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Id: default Jun 30 10:12:43.671612 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Name: Default Jun 30 10:12:43.671612 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Id: 108ee256fba04d1b83fe00c166742f0b Jun 30 10:12:43.671612 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Name: tempest-TestVolumeBootPattern-755875873 Jun 30 10:12:43.671612 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Role: reader,member Jun 30 10:12:43.671612 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Roles: reader,member Jun 30 10:12:43.673395 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/108ee256fba04d1b83fe00c166742f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/108ee256fba04d1b83fe00c166742f0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/108ee256fba04d1b83fe00c166742f0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_108ee256fba04d1b83fe00c166742f0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:12:43.673395 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant: tempest-TestVolumeBootPattern-755875873 Jun 30 10:12:43.673395 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Id: 108ee256fba04d1b83fe00c166742f0b Jun 30 10:12:43.673395 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Name: tempest-TestVolumeBootPattern-755875873 Jun 30 10:12:43.673395 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User: tempest-TestVolumeBootPattern-755875873-project Jun 30 10:12:43.673395 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Id: default Jun 30 10:12:43.673395 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Name: Default Jun 30 10:12:43.673395 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Id: ead8ee09f8514e75882c877042764a92 Jun 30 10:12:43.673395 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Name: tempest-TestVolumeBootPattern-755875873-project Jun 30 10:12:43.673395 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: method: > Jun 30 10:12:43.673395 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: exception: Instance 1802a0eb-4ac0-4939-b119-af84e90c5859 could not be found. Jun 30 10:12:43.673395 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: action_args: {'id': '1802a0eb-4ac0-4939-b119-af84e90c5859'} Jun 30 10:12:43.674618 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:12:43.674618 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:12:43.674618 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:12:43.674618 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:12:43.674618 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:12:43.674618 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:12:43.674618 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:12:43.674618 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:12:43.674618 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:12:43.674618 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:12:43.674618 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1802a0eb-4ac0-4939-b119-af84e90c5859 could not be found. Jun 30 10:12:43.674618 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:12:43.674618 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:12:43.674618 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:12:43.674618 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:12:43.674618 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:12:43.674618 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:12:43.674618 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:12:43.674618 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:12:43.674618 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:12:43.677372 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:12:43.677372 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 10:12:43.677372 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 10:12:43.677372 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 10:12:43.677372 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 10:12:43.677372 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:12:43.677372 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:12:43.677372 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:12:43.677372 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:12:43.677372 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1802a0eb-4ac0-4939-b119-af84e90c5859 could not be found. Jun 30 10:12:43.677372 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:12:43.677372 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:12:43.677372 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:12:43.677372 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:12:43.677372 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:12:43.677372 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:12:43.677372 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:12:43.677372 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:12:43.677372 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1802a0eb-4ac0-4939-b119-af84e90c5859 could not be found. Jun 30 10:12:43.677372 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:12:43.680133 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-ff2d0229-e3b8-4e5f-9ada-51f304acdfa5 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Returning 404 to user: Instance 1802a0eb-4ac0-4939-b119-af84e90c5859 could not be found. {{(pid=117847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:12:43.680133 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-ff2d0229-e3b8-4e5f-9ada-51f304acdfa5 tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859" status: 404 len: 111 microversion: 2.1 time: 0.032642 Jun 30 10:12:43.680133 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 538/1092] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 10:12:43 2022] DELETE /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:12:43.682402 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-2e40dffb-7930-4b1f-a202-acabae2cf78e tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:12:43.683048 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-2e40dffb-7930-4b1f-a202-acabae2cf78e tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] [instance: 1802a0eb-4ac0-4939-b119-af84e90c5859] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:12:43.689795 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2e40dffb-7930-4b1f-a202-acabae2cf78e tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:43.690223 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2e40dffb-7930-4b1f-a202-acabae2cf78e tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:43.691041 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2e40dffb-7930-4b1f-a202-acabae2cf78e tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:12:43.692401 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2e40dffb-7930-4b1f-a202-acabae2cf78e tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:12:43.708382 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-2e40dffb-7930-4b1f-a202-acabae2cf78e tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] HTTP exception thrown: Instance 1802a0eb-4ac0-4939-b119-af84e90c5859 could not be found. Jun 30 10:12:43.709944 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-2e40dffb-7930-4b1f-a202-acabae2cf78e tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Request method failure captured: Jun 30 10:12:43.709944 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: request: GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859 HTTP/1.1 Jun 30 10:12:43.709944 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept: application/json Jun 30 10:12:43.709944 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jun 30 10:12:43.709944 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Connection: close Jun 30 10:12:43.709944 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jun 30 10:12:43.709944 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jun 30 10:12:43.709944 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Host: 10.222.0.16 Jun 30 10:12:43.709944 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jun 30 10:12:43.709944 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jun 30 10:12:43.709944 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABivXV52OD_4Rc9L3x6-t_Z1lNdOD-WFD2ojgW-2JKeZGoZHbpypR-rdoNl09Ij-K_fFClJQU2sEjXV1toYuhue3UW9VcXZ_9kNxqCkETc-0LJvGV1J0XlnsL8h5_RyD57luBBUztLHMf5Zix_mSPGFqYW_X5HpyPAE0L2QT7PaLxmaRIY Jun 30 10:12:43.709944 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jun 30 10:12:43.709944 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jun 30 10:12:43.709944 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jun 30 10:12:43.709944 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jun 30 10:12:43.709944 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jun 30 10:12:43.709944 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jun 30 10:12:43.709944 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Id: 108ee256fba04d1b83fe00c166742f0b Jun 30 10:12:43.709944 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-TestVolumeBootPattern-755875873 Jun 30 10:12:43.709944 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Role: reader,member Jun 30 10:12:43.709944 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Roles: reader,member Jun 30 10:12:43.711588 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/108ee256fba04d1b83fe00c166742f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/108ee256fba04d1b83fe00c166742f0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/108ee256fba04d1b83fe00c166742f0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_108ee256fba04d1b83fe00c166742f0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:12:43.711588 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-TestVolumeBootPattern-755875873 Jun 30 10:12:43.711588 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 108ee256fba04d1b83fe00c166742f0b Jun 30 10:12:43.711588 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-TestVolumeBootPattern-755875873 Jun 30 10:12:43.711588 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User: tempest-TestVolumeBootPattern-755875873-project Jun 30 10:12:43.711588 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jun 30 10:12:43.711588 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jun 30 10:12:43.711588 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Id: ead8ee09f8514e75882c877042764a92 Jun 30 10:12:43.711588 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-TestVolumeBootPattern-755875873-project Jun 30 10:12:43.711588 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: method: > Jun 30 10:12:43.711588 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: exception: Instance 1802a0eb-4ac0-4939-b119-af84e90c5859 could not be found. Jun 30 10:12:43.711588 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: action_args: {'id': '1802a0eb-4ac0-4939-b119-af84e90c5859'} Jun 30 10:12:43.712688 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:12:43.712688 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:12:43.712688 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:12:43.712688 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:12:43.712688 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:12:43.712688 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:12:43.712688 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:12:43.712688 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:12:43.712688 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:12:43.712688 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:12:43.712688 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1802a0eb-4ac0-4939-b119-af84e90c5859 could not be found. Jun 30 10:12:43.712688 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:12:43.712688 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:12:43.712688 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:12:43.712688 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:12:43.712688 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:12:43.712688 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:12:43.712688 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:12:43.712688 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:12:43.712688 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:12:43.714335 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:12:43.714335 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:12:43.714335 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:12:43.714335 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:12:43.714335 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:12:43.714335 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:12:43.714335 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:12:43.714335 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1802a0eb-4ac0-4939-b119-af84e90c5859 could not be found. Jun 30 10:12:43.714335 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:12:43.714335 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:12:43.714335 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:12:43.714335 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:12:43.714335 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:12:43.714335 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:12:43.714335 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:12:43.714335 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:12:43.714335 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1802a0eb-4ac0-4939-b119-af84e90c5859 could not be found. Jun 30 10:12:43.714335 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jun 30 10:12:43.716114 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-2e40dffb-7930-4b1f-a202-acabae2cf78e tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Returning 404 to user: Instance 1802a0eb-4ac0-4939-b119-af84e90c5859 could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:12:43.716114 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-2e40dffb-7930-4b1f-a202-acabae2cf78e tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859" status: 404 len: 111 microversion: 2.1 time: 0.032862 Jun 30 10:12:43.716114 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 555/1093] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:12:43 2022] GET /compute/v2.1/servers/1802a0eb-4ac0-4939-b119-af84e90c5859 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:12:45.039288 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-8403ee11-2629-481f-9e9d-56370ac56eaa tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] Calling method '.version_select at 0x7fc224bd2ca0>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:12:45.061678 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-8403ee11-2629-481f-9e9d-56370ac56eaa tempest-TestVolumeBootPattern-755875873 tempest-TestVolumeBootPattern-755875873-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-121302753" status: 202 len: 0 microversion: 2.1 time: 0.026275 Jun 30 10:12:45.062483 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 539/1094] 10.222.0.16 () {58 vars in 1259 bytes} [Thu Jun 30 10:12:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-121302753 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:13:29.318478 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-3f6e6104-ef86-47b4-b0e1-8c187fa2ee94 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:13:29.322176 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:13:29.323475 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG dbcounter [-] [117847] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:13:29.327281 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [req-1dcf9ec5-8553-4749-9d2f-1121fa698906 req-8a375e28-0170-4937-9a43-f55e67adb4e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0947fb10-14c6-4e0e-ad30-45bb44422c9f", "tag": "e7fe2382-c98a-487a-ad01-556028fac2e1"}]} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:13:29.336042 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-3f6e6104-ef86-47b4-b0e1-8c187fa2ee94 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:13:29.338571 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=18 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:13:29.339242 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=26 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:13:29.344888 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3f6e6104-ef86-47b4-b0e1-8c187fa2ee94 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:13:29.345331 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3f6e6104-ef86-47b4-b0e1-8c187fa2ee94 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:13:29.346096 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3f6e6104-ef86-47b4-b0e1-8c187fa2ee94 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:13:29.346522 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3f6e6104-ef86-47b4-b0e1-8c187fa2ee94 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:13:29.352925 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-1dcf9ec5-8553-4749-9d2f-1121fa698906 req-8a375e28-0170-4937-9a43-f55e67adb4e1 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:13:29.353364 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-1dcf9ec5-8553-4749-9d2f-1121fa698906 req-8a375e28-0170-4937-9a43-f55e67adb4e1 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:13:29.365612 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.compute.server_external_events [req-1dcf9ec5-8553-4749-9d2f-1121fa698906 req-8a375e28-0170-4937-9a43-f55e67adb4e1 service nova] Creating event network-changed:e7fe2382-c98a-487a-ad01-556028fac2e1 for instance 0947fb10-14c6-4e0e-ad30-45bb44422c9f on hv-cinder-84330 Jun 30 10:13:29.371269 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [req-1dcf9ec5-8553-4749-9d2f-1121fa698906 req-8a375e28-0170-4937-9a43-f55e67adb4e1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050451 Jun 30 10:13:29.371975 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 540/1095] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 10:13:29.374815 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-3f6e6104-ef86-47b4-b0e1-8c187fa2ee94 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] Going to try to terminate instance {{(pid=117846) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 10:13:29.466500 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-3f6e6104-ef86-47b4-b0e1-8c187fa2ee94 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f" status: 204 len: 0 microversion: 2.1 time: 0.151740 Jun 30 10:13:29.467087 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 556/1096] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 10:13:29 2022] DELETE /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 10:13:29.475847 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-b4855b4d-db5a-44f7-b75d-5c74a5952507 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:13:29.476566 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-b4855b4d-db5a-44f7-b75d-5c74a5952507 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:13:29.482780 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b4855b4d-db5a-44f7-b75d-5c74a5952507 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:13:29.483304 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b4855b4d-db5a-44f7-b75d-5c74a5952507 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:13:29.484088 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b4855b4d-db5a-44f7-b75d-5c74a5952507 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:13:29.484692 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-b4855b4d-db5a-44f7-b75d-5c74a5952507 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:13:29.637956 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.policy [None req-b4855b4d-db5a-44f7-b75d-5c74a5952507 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc71c372e584ddf91290eefb53a973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c9f15ea7b84f54a6cfa004bd02de6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117847) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:13:29.645934 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-b4855b4d-db5a-44f7-b75d-5c74a5952507 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f" status: 200 len: 1569 microversion: 2.1 time: 0.174367 Jun 30 10:13:29.646504 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 541/1097] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:13:29 2022] GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:13:30.663687 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-1677b2df-a22f-4358-8a89-f8a84e1a515d tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:13:30.664534 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-1677b2df-a22f-4358-8a89-f8a84e1a515d tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:13:30.671777 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1677b2df-a22f-4358-8a89-f8a84e1a515d tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:13:30.672262 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1677b2df-a22f-4358-8a89-f8a84e1a515d tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:13:30.673018 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1677b2df-a22f-4358-8a89-f8a84e1a515d tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:13:30.673443 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1677b2df-a22f-4358-8a89-f8a84e1a515d tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:13:30.872839 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-1677b2df-a22f-4358-8a89-f8a84e1a515d tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc71c372e584ddf91290eefb53a973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c9f15ea7b84f54a6cfa004bd02de6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:13:30.885280 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-1677b2df-a22f-4358-8a89-f8a84e1a515d tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f" status: 200 len: 1569 microversion: 2.1 time: 0.225599 Jun 30 10:13:30.886112 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 557/1098] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:13:30 2022] GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f => generated 1569 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:13:31.461934 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [req-9487a300-89bf-4341-9d5f-5cb975fe8795 req-8ff33a87-b1a9-45fd-bdd0-717e58ccde61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0947fb10-14c6-4e0e-ad30-45bb44422c9f", "name": "network-vif-deleted", "tag": "e7fe2382-c98a-487a-ad01-556028fac2e1"}]} {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 10:13:31.471124 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-9487a300-89bf-4341-9d5f-5cb975fe8795 req-8ff33a87-b1a9-45fd-bdd0-717e58ccde61 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:13:31.471541 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [req-9487a300-89bf-4341-9d5f-5cb975fe8795 req-8ff33a87-b1a9-45fd-bdd0-717e58ccde61 service nova] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:13:31.483843 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.compute.server_external_events [req-9487a300-89bf-4341-9d5f-5cb975fe8795 req-8ff33a87-b1a9-45fd-bdd0-717e58ccde61 service nova] Creating event network-vif-deleted:e7fe2382-c98a-487a-ad01-556028fac2e1 for instance 0947fb10-14c6-4e0e-ad30-45bb44422c9f on hv-cinder-84330 Jun 30 10:13:31.488897 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [req-9487a300-89bf-4341-9d5f-5cb975fe8795 req-8ff33a87-b1a9-45fd-bdd0-717e58ccde61 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030679 Jun 30 10:13:31.489498 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 542/1099] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 10:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 10:13:31.904217 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-d5d4cb65-0745-43d6-97ba-4e618b3f4faa tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:13:31.904788 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-d5d4cb65-0745-43d6-97ba-4e618b3f4faa tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:13:31.912138 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d5d4cb65-0745-43d6-97ba-4e618b3f4faa tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:13:31.912583 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d5d4cb65-0745-43d6-97ba-4e618b3f4faa tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:13:31.913392 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d5d4cb65-0745-43d6-97ba-4e618b3f4faa tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:13:31.913821 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d5d4cb65-0745-43d6-97ba-4e618b3f4faa tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:13:31.947170 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d5d4cb65-0745-43d6-97ba-4e618b3f4faa tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:13:31.947555 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d5d4cb65-0745-43d6-97ba-4e618b3f4faa tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:13:31.948093 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.objects.instance [None req-d5d4cb65-0745-43d6-97ba-4e618b3f4faa tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lazy-loading 'fault' on Instance uuid 0947fb10-14c6-4e0e-ad30-45bb44422c9f {{(pid=117846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 10:13:31.992519 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-d5d4cb65-0745-43d6-97ba-4e618b3f4faa tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc71c372e584ddf91290eefb53a973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c9f15ea7b84f54a6cfa004bd02de6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 10:13:32.000148 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-d5d4cb65-0745-43d6-97ba-4e618b3f4faa tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f" status: 200 len: 1225 microversion: 2.1 time: 0.100249 Jun 30 10:13:32.000677 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 558/1100] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:13:31 2022] GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 10:13:33.021417 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-25e23426-6858-47a7-947d-245671ad4936 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Calling method '>' {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:13:33.022320 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.compute.api [None req-25e23426-6858-47a7-947d-245671ad4936 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] [instance: 0947fb10-14c6-4e0e-ad30-45bb44422c9f] Fetching instance by UUID {{(pid=117847) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 10:13:33.030554 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-25e23426-6858-47a7-947d-245671ad4936 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:13:33.031185 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-25e23426-6858-47a7-947d-245671ad4936 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:13:33.032183 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-25e23426-6858-47a7-947d-245671ad4936 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 10:13:33.032720 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG oslo_concurrency.lockutils [None req-25e23426-6858-47a7-947d-245671ad4936 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Lock "c89fa87a-864c-4617-9f03-4ca146aad90b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 10:13:33.049241 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.wsgi [None req-25e23426-6858-47a7-947d-245671ad4936 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] HTTP exception thrown: Instance 0947fb10-14c6-4e0e-ad30-45bb44422c9f could not be found. Jun 30 10:13:33.051210 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-25e23426-6858-47a7-947d-245671ad4936 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Request method failure captured: Jun 30 10:13:33.051210 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: request: GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f HTTP/1.1 Jun 30 10:13:33.051210 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept: application/json Jun 30 10:13:33.051210 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Accept-Encoding: identity Jun 30 10:13:33.051210 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Connection: close Jun 30 10:13:33.051210 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Length: 0 Jun 30 10:13:33.051210 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Content-Type: application/json Jun 30 10:13:33.051210 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Host: 10.222.0.16 Jun 30 10:13:33.051210 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Openstack-System-Scope: None Jun 30 10:13:33.051210 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: User-Agent: python-urllib3/1.26.9 Jun 30 10:13:33.051210 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Auth-Token: gAAAAABivXZPcWwI_-3vLh73Ch8hmKrDjh8wQTB8zsY-HUAxyRpFnRm7GBKkRXP5j5IcMAaCGMYP_JlVl8vtOJfNCErrJA1RA4rkbHNWs5RX2fXiLM30AvWhnySlM_X4YLCfPz16jQ8HhgKMpgf9VZNCR5Y_1yCXtOGL13wbGYBrcZ6dxkYRrvA Jun 30 10:13:33.051210 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Id: None Jun 30 10:13:33.051210 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Domain-Name: None Jun 30 10:13:33.051210 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Identity-Status: Confirmed Jun 30 10:13:33.051210 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Is-Admin-Project: True Jun 30 10:13:33.051210 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Id: default Jun 30 10:13:33.051210 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Domain-Name: Default Jun 30 10:13:33.051210 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Id: 84c9f15ea7b84f54a6cfa004bd02de6e Jun 30 10:13:33.051210 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Project-Name: tempest-TestShelveInstance-996058151 Jun 30 10:13:33.051210 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Role: reader,member Jun 30 10:13:33.051210 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Roles: reader,member Jun 30 10:13:33.052845 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84c9f15ea7b84f54a6cfa004bd02de6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84c9f15ea7b84f54a6cfa004bd02de6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84c9f15ea7b84f54a6cfa004bd02de6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84c9f15ea7b84f54a6cfa004bd02de6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jun 30 10:13:33.052845 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant: tempest-TestShelveInstance-996058151 Jun 30 10:13:33.052845 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Id: 84c9f15ea7b84f54a6cfa004bd02de6e Jun 30 10:13:33.052845 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-Tenant-Name: tempest-TestShelveInstance-996058151 Jun 30 10:13:33.052845 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User: tempest-TestShelveInstance-996058151-project Jun 30 10:13:33.052845 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Id: default Jun 30 10:13:33.052845 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Domain-Name: Default Jun 30 10:13:33.052845 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Id: fbc71c372e584ddf91290eefb53a973a Jun 30 10:13:33.052845 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: X-User-Name: tempest-TestShelveInstance-996058151-project Jun 30 10:13:33.052845 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: method: > Jun 30 10:13:33.052845 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: exception: Instance 0947fb10-14c6-4e0e-ad30-45bb44422c9f could not be found. Jun 30 10:13:33.052845 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: action_args: {'id': '0947fb10-14c6-4e0e-ad30-45bb44422c9f'} Jun 30 10:13:33.053795 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: {{(pid=117847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 10:13:33.053795 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:13:33.053795 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 10:13:33.053795 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 10:13:33.053795 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 10:13:33.053795 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 10:13:33.053795 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 10:13:33.053795 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 10:13:33.053795 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 10:13:33.053795 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 10:13:33.053795 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0947fb10-14c6-4e0e-ad30-45bb44422c9f could not be found. Jun 30 10:13:33.053795 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:13:33.053795 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:13:33.053795 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:13:33.053795 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:13:33.053795 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:13:33.053795 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:13:33.053795 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 10:13:33.053795 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 10:13:33.053795 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 10:13:33.055175 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 10:13:33.055175 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 10:13:33.055175 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 10:13:33.055175 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 10:13:33.055175 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 10:13:33.055175 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 10:13:33.055175 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 10:13:33.055175 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0947fb10-14c6-4e0e-ad30-45bb44422c9f could not be found. Jun 30 10:13:33.055175 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:13:33.055175 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 10:13:33.055175 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:13:33.055175 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 10:13:33.055175 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 10:13:33.055175 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 10:13:33.055175 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 10:13:33.055175 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 10:13:33.055175 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0947fb10-14c6-4e0e-ad30-45bb44422c9f could not be found. Jun 30 10:13:33.055175 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: ERROR nova.api.openstack.wsgi Jun 30 10:13:33.056429 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: DEBUG nova.api.openstack.wsgi [None req-25e23426-6858-47a7-947d-245671ad4936 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Returning 404 to user: Instance 0947fb10-14c6-4e0e-ad30-45bb44422c9f could not be found. {{(pid=117847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 10:13:33.056429 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO nova.api.openstack.requestlog [None req-25e23426-6858-47a7-947d-245671ad4936 tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f" status: 404 len: 111 microversion: 2.1 time: 0.037270 Jun 30 10:13:33.056429 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: [pid: 117847|app: 0|req: 543/1101] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 10:13:33 2022] GET /compute/v2.1/servers/0947fb10-14c6-4e0e-ad30-45bb44422c9f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 10:13:33.226161 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-78d8ca44-39ea-46d1-895e-5521f203d9fa tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] Calling method '.version_select at 0x7fc22059faf0>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 10:13:33.247359 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-78d8ca44-39ea-46d1-895e-5521f203d9fa tempest-TestShelveInstance-996058151 tempest-TestShelveInstance-996058151-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1371658480" status: 202 len: 0 microversion: 2.1 time: 0.025123 Jun 30 10:13:33.248152 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 559/1102] 10.222.0.16 () {58 vars in 1253 bytes} [Thu Jun 30 10:13:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1371658480 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 10:14:09.220799 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 10:14:09.222031 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Thu Jun 30 10:14:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 10:15:43.568810 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 10:15:43.569805 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Thu Jun 30 10:15:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 10:15:53.528992 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 10:15:53.529897 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Thu Jun 30 10:15:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 10:15:55.828235 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 10:15:55.828897 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Thu Jun 30 10:15:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 10:17:14.042630 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 10:17:14.044343 dv-cinder-843309-3-iscsi devstack@n-api.service[117847]: Thu Jun 30 10:17:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 10:17:29.234718 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 10:17:29.235981 dv-cinder-843309-3-iscsi devstack@n-api.service[117846]: Thu Jun 30 10:17:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!